Quality standards in respiratory real-life effectiveness research: the REal Life EVidence AssessmeNt Tool (RELEVANT)

report from the Respiratory Effectiveness Group—European Academy of Allergy and Clinical Immunology Task Force

Nicolas Roche (Corresponding Author), Jonathan D. Campbell, Jerry A. Krishnan, Guy Brusselle, Alison Chisholm, Leif Bjermer, Mike Thomas, Eric van Ganse, Maarten van den Berge, George Christoff, Jennifer Quint, Nikolaos G. Papadopoulos, David Price

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Introduction
A Task Force was commissioned jointly by the European Academy of Allergy and Clinical Immunology (EAACI) and the Respiratory Effectiveness Group (REG) to develop a quality assessment tool for real-life observational research to identify high-quality real-life asthma studies that could be considered within future guideline development.

Methods
The resulting REal Life EVidence AssessmeNt Tool (RELEVANT) was achieved through an extensive analysis of existing initiatives in this area. The first version was piloted among 9 raters across 6 articles; the revised, interim, version underwent extensive testing by 22 reviewers from the EAACI membership and REG collaborator group, leading to further revisions and tool finalisation. RELEVANT was validated through an analysis of real-life effectiveness studies identified via systematic review of Medline and Embase databases and relating to topics for which real-life studies may offer valuable evidence complementary to that from randomised controlled trials. The topics were selected through a vote among Task Force members and related to the influence of adherence, smoking, inhaler device and particle size on asthma treatment effectiveness.

Results
Although highlighting a general lack of high-quality real-life effectiveness observational research on these clinically important topics, the analysis provided insights into how identified observational studies might inform asthma guidelines developers and clinicians. Overall, RELEVANT appeared reliable and easy to use by expert reviewers.

Conclusions
Using such quality appraisal tools is mandatory to assess whether specific observational real-life effectiveness studies can be used to inform guideline development and/or decision-making in clinical practice.
Original languageEnglish
Article number20
Number of pages17
JournalClinical and Translational Allergy
Volume9
Issue number1
DOIs
Publication statusPublished - 27 Mar 2019

Fingerprint

Advisory Committees
Allergy and Immunology
Research
Asthma
Guidelines
Quality of Life
Nebulizers and Vaporizers
Particle Size
Observational Studies
Randomized Controlled Trials
Smoking
Databases
Equipment and Supplies

Keywords

  • asthma
  • comparative effectiveness
  • quality standards
  • observational studies
  • database

Cite this

Quality standards in respiratory real-life effectiveness research: the REal Life EVidence AssessmeNt Tool (RELEVANT) : report from the Respiratory Effectiveness Group—European Academy of Allergy and Clinical Immunology Task Force. / Roche, Nicolas (Corresponding Author); Campbell, Jonathan D.; Krishnan, Jerry A.; Brusselle, Guy; Chisholm, Alison; Bjermer, Leif; Thomas, Mike; van Ganse, Eric; van den Berge, Maarten; Christoff, George; Quint, Jennifer; Papadopoulos, Nikolaos G.; Price, David.

In: Clinical and Translational Allergy, Vol. 9, No. 1, 20, 27.03.2019.

Research output: Contribution to journalArticle

Roche, Nicolas ; Campbell, Jonathan D. ; Krishnan, Jerry A. ; Brusselle, Guy ; Chisholm, Alison ; Bjermer, Leif ; Thomas, Mike ; van Ganse, Eric ; van den Berge, Maarten ; Christoff, George ; Quint, Jennifer ; Papadopoulos, Nikolaos G. ; Price, David. / Quality standards in respiratory real-life effectiveness research: the REal Life EVidence AssessmeNt Tool (RELEVANT) : report from the Respiratory Effectiveness Group—European Academy of Allergy and Clinical Immunology Task Force. In: Clinical and Translational Allergy. 2019 ; Vol. 9, No. 1.
@article{0997eb4179274f3981c06b5b4a3a2021,
title = "Quality standards in respiratory real-life effectiveness research: the REal Life EVidence AssessmeNt Tool (RELEVANT): report from the Respiratory Effectiveness Group—European Academy of Allergy and Clinical Immunology Task Force",
abstract = "IntroductionA Task Force was commissioned jointly by the European Academy of Allergy and Clinical Immunology (EAACI) and the Respiratory Effectiveness Group (REG) to develop a quality assessment tool for real-life observational research to identify high-quality real-life asthma studies that could be considered within future guideline development.MethodsThe resulting REal Life EVidence AssessmeNt Tool (RELEVANT) was achieved through an extensive analysis of existing initiatives in this area. The first version was piloted among 9 raters across 6 articles; the revised, interim, version underwent extensive testing by 22 reviewers from the EAACI membership and REG collaborator group, leading to further revisions and tool finalisation. RELEVANT was validated through an analysis of real-life effectiveness studies identified via systematic review of Medline and Embase databases and relating to topics for which real-life studies may offer valuable evidence complementary to that from randomised controlled trials. The topics were selected through a vote among Task Force members and related to the influence of adherence, smoking, inhaler device and particle size on asthma treatment effectiveness.ResultsAlthough highlighting a general lack of high-quality real-life effectiveness observational research on these clinically important topics, the analysis provided insights into how identified observational studies might inform asthma guidelines developers and clinicians. Overall, RELEVANT appeared reliable and easy to use by expert reviewers.ConclusionsUsing such quality appraisal tools is mandatory to assess whether specific observational real-life effectiveness studies can be used to inform guideline development and/or decision-making in clinical practice.",
keywords = "asthma, comparative effectiveness, quality standards, observational studies, database",
author = "Nicolas Roche and Campbell, {Jonathan D.} and Krishnan, {Jerry A.} and Guy Brusselle and Alison Chisholm and Leif Bjermer and Mike Thomas and {van Ganse}, Eric and {van den Berge}, Maarten and George Christoff and Jennifer Quint and Papadopoulos, {Nikolaos G.} and David Price",
note = "Acknowledgements The authors would like to thank Katy Gallop and Sarah Acaster who contributed to the literature search and Zoe Mitchell who designed the web-based version of the tool. Funding This study was funded by the Respiratory Effectiveness Group (REG), and the European Academy of Allergy and Clinical Immunology (EAACI). Availability of data and materials The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.",
year = "2019",
month = "3",
day = "27",
doi = "10.1186/s13601-019-0255-x",
language = "English",
volume = "9",
journal = "Clinical and Translational Allergy",
issn = "2045-7022",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - Quality standards in respiratory real-life effectiveness research: the REal Life EVidence AssessmeNt Tool (RELEVANT)

T2 - report from the Respiratory Effectiveness Group—European Academy of Allergy and Clinical Immunology Task Force

AU - Roche, Nicolas

AU - Campbell, Jonathan D.

AU - Krishnan, Jerry A.

AU - Brusselle, Guy

AU - Chisholm, Alison

AU - Bjermer, Leif

AU - Thomas, Mike

AU - van Ganse, Eric

AU - van den Berge, Maarten

AU - Christoff, George

AU - Quint, Jennifer

AU - Papadopoulos, Nikolaos G.

AU - Price, David

N1 - Acknowledgements The authors would like to thank Katy Gallop and Sarah Acaster who contributed to the literature search and Zoe Mitchell who designed the web-based version of the tool. Funding This study was funded by the Respiratory Effectiveness Group (REG), and the European Academy of Allergy and Clinical Immunology (EAACI). Availability of data and materials The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

PY - 2019/3/27

Y1 - 2019/3/27

N2 - IntroductionA Task Force was commissioned jointly by the European Academy of Allergy and Clinical Immunology (EAACI) and the Respiratory Effectiveness Group (REG) to develop a quality assessment tool for real-life observational research to identify high-quality real-life asthma studies that could be considered within future guideline development.MethodsThe resulting REal Life EVidence AssessmeNt Tool (RELEVANT) was achieved through an extensive analysis of existing initiatives in this area. The first version was piloted among 9 raters across 6 articles; the revised, interim, version underwent extensive testing by 22 reviewers from the EAACI membership and REG collaborator group, leading to further revisions and tool finalisation. RELEVANT was validated through an analysis of real-life effectiveness studies identified via systematic review of Medline and Embase databases and relating to topics for which real-life studies may offer valuable evidence complementary to that from randomised controlled trials. The topics were selected through a vote among Task Force members and related to the influence of adherence, smoking, inhaler device and particle size on asthma treatment effectiveness.ResultsAlthough highlighting a general lack of high-quality real-life effectiveness observational research on these clinically important topics, the analysis provided insights into how identified observational studies might inform asthma guidelines developers and clinicians. Overall, RELEVANT appeared reliable and easy to use by expert reviewers.ConclusionsUsing such quality appraisal tools is mandatory to assess whether specific observational real-life effectiveness studies can be used to inform guideline development and/or decision-making in clinical practice.

AB - IntroductionA Task Force was commissioned jointly by the European Academy of Allergy and Clinical Immunology (EAACI) and the Respiratory Effectiveness Group (REG) to develop a quality assessment tool for real-life observational research to identify high-quality real-life asthma studies that could be considered within future guideline development.MethodsThe resulting REal Life EVidence AssessmeNt Tool (RELEVANT) was achieved through an extensive analysis of existing initiatives in this area. The first version was piloted among 9 raters across 6 articles; the revised, interim, version underwent extensive testing by 22 reviewers from the EAACI membership and REG collaborator group, leading to further revisions and tool finalisation. RELEVANT was validated through an analysis of real-life effectiveness studies identified via systematic review of Medline and Embase databases and relating to topics for which real-life studies may offer valuable evidence complementary to that from randomised controlled trials. The topics were selected through a vote among Task Force members and related to the influence of adherence, smoking, inhaler device and particle size on asthma treatment effectiveness.ResultsAlthough highlighting a general lack of high-quality real-life effectiveness observational research on these clinically important topics, the analysis provided insights into how identified observational studies might inform asthma guidelines developers and clinicians. Overall, RELEVANT appeared reliable and easy to use by expert reviewers.ConclusionsUsing such quality appraisal tools is mandatory to assess whether specific observational real-life effectiveness studies can be used to inform guideline development and/or decision-making in clinical practice.

KW - asthma

KW - comparative effectiveness

KW - quality standards

KW - observational studies

KW - database

U2 - 10.1186/s13601-019-0255-x

DO - 10.1186/s13601-019-0255-x

M3 - Article

VL - 9

JO - Clinical and Translational Allergy

JF - Clinical and Translational Allergy

SN - 2045-7022

IS - 1

M1 - 20

ER -