Do Pharmacy Intervention Reports Adequately Describe Their Interventions? A Template for Intervention Description and Replication Analysis of Reports included in a Systematic Review

Micheal de Barra (Corresponding Author), Claire Scott, Marie Johnston, Marijn de Bruin, Neil Scott, Catriona Matheson, Christine Bond, Margaret Watson

Research output: Contribution to journalArticle

Abstract

Introduction Scientific progress and translation of evidence into practice is impeded by poorly described interventions. The Template for Intervention Description and Replication (TIDieR) was developed to specify the minimal intervention elements that should be reported.

Objectives (1) To assess the extent to which outpatient pharmacy interventions were adequately reported. (2) To examine the dimension(s) across which reporting quality varies. (3) To examine trial characteristics that predict better reporting.

Methods The sample comprised 86 randomised controlled trials identified in a Cochrane review of the effectiveness of pharmacist interventions on patient health outcomes. Duplicate, independent application of a modified 15-item TIDieR checklist was undertaken to assess the intervention reporting. The reporting/non-reporting of TIDieR items was analysed with principal component analysis to evaluate the dimensionality of reporting quality and regression analyses to assess predictors of reporting quality

Results
In total, 422 (40%) TIDieR items were fully reported, 395 (38%) were partially reported and 231 (22%) were not reported. A further 242 items were deemed not applicable to the specific trials. Reporting quality loaded on one component which accounted for 26% of the variance in TIDieR scores. More recent trials reported a slightly greater number of TIDieR items (0.07 (95% CI 0.02 to 0.13) additional TIDieR items per year of publication). Trials reported an 0.09 (95% CI 0.04 to 0.14) additional TIDieR items per unit increase in impact factor (IF) of the journal in which the main report was published.

Conclusions Most trials lacked adequate intervention reporting. This diminished the applied and scientific value of their research. The standard of intervention reporting is, however, gradually increasing and appears somewhat better in journals with higher IFs. The use of the TIDieR checklist to improve reporting could enhance the utility and replicability of trials, and reduce research waste.
Original languageEnglish
Article numbere025511
Pages (from-to)e025511
Number of pages8
JournalBMJ Open
Volume9
Issue number12
Early online date19 Dec 2019
DOIs
Publication statusPublished - 2019

Fingerprint

Checklist
Journal Impact Factor
Principal Component Analysis
Pharmacists
Research
Publications
Outpatients
Randomized Controlled Trials
Regression Analysis
Health

Keywords

  • checklist
  • clinical trials as topic/standards
  • pharmacy/standards
  • reproducibility of results
  • research report/standards

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Do Pharmacy Intervention Reports Adequately Describe Their Interventions? A Template for Intervention Description and Replication Analysis of Reports included in a Systematic Review. / de Barra, Micheal (Corresponding Author); Scott, Claire; Johnston, Marie; de Bruin, Marijn; Scott, Neil; Matheson, Catriona; Bond, Christine; Watson, Margaret.

In: BMJ Open, Vol. 9, No. 12, e025511, 2019, p. e025511.

Research output: Contribution to journalArticle

@article{bc294e24e0aa42adb378055d1103ab38,
title = "Do Pharmacy Intervention Reports Adequately Describe Their Interventions? A Template for Intervention Description and Replication Analysis of Reports included in a Systematic Review",
abstract = "Introduction Scientific progress and translation of evidence into practice is impeded by poorly described interventions. The Template for Intervention Description and Replication (TIDieR) was developed to specify the minimal intervention elements that should be reported.Objectives (1) To assess the extent to which outpatient pharmacy interventions were adequately reported. (2) To examine the dimension(s) across which reporting quality varies. (3) To examine trial characteristics that predict better reporting.Methods The sample comprised 86 randomised controlled trials identified in a Cochrane review of the effectiveness of pharmacist interventions on patient health outcomes. Duplicate, independent application of a modified 15-item TIDieR checklist was undertaken to assess the intervention reporting. The reporting/non-reporting of TIDieR items was analysed with principal component analysis to evaluate the dimensionality of reporting quality and regression analyses to assess predictors of reporting qualityResults In total, 422 (40{\%}) TIDieR items were fully reported, 395 (38{\%}) were partially reported and 231 (22{\%}) were not reported. A further 242 items were deemed not applicable to the specific trials. Reporting quality loaded on one component which accounted for 26{\%} of the variance in TIDieR scores. More recent trials reported a slightly greater number of TIDieR items (0.07 (95{\%} CI 0.02 to 0.13) additional TIDieR items per year of publication). Trials reported an 0.09 (95{\%} CI 0.04 to 0.14) additional TIDieR items per unit increase in impact factor (IF) of the journal in which the main report was published.Conclusions Most trials lacked adequate intervention reporting. This diminished the applied and scientific value of their research. The standard of intervention reporting is, however, gradually increasing and appears somewhat better in journals with higher IFs. The use of the TIDieR checklist to improve reporting could enhance the utility and replicability of trials, and reduce research waste.",
keywords = "checklist, clinical trials as topic/standards, pharmacy/standards, reproducibility of results, research report/standards",
author = "{de Barra}, Micheal and Claire Scott and Marie Johnston and {de Bruin}, Marijn and Neil Scott and Catriona Matheson and Christine Bond and Margaret Watson",
note = "Funding: Funding was provided by the Chief Scientist Office, grant number CZH/4/1041. MidB was also funded by the Professor Roy Weir Career Development Fellowship. MW was funded by a Health Foundation Improvement Science Fellowship.",
year = "2019",
doi = "10.1136/bmjopen-2018-025511",
language = "English",
volume = "9",
pages = "e025511",
journal = "BMJ Open",
issn = "2044-6055",
publisher = "BMJ Publishing Group",
number = "12",

}

TY - JOUR

T1 - Do Pharmacy Intervention Reports Adequately Describe Their Interventions? A Template for Intervention Description and Replication Analysis of Reports included in a Systematic Review

AU - de Barra, Micheal

AU - Scott, Claire

AU - Johnston, Marie

AU - de Bruin, Marijn

AU - Scott, Neil

AU - Matheson, Catriona

AU - Bond, Christine

AU - Watson, Margaret

N1 - Funding: Funding was provided by the Chief Scientist Office, grant number CZH/4/1041. MidB was also funded by the Professor Roy Weir Career Development Fellowship. MW was funded by a Health Foundation Improvement Science Fellowship.

PY - 2019

Y1 - 2019

N2 - Introduction Scientific progress and translation of evidence into practice is impeded by poorly described interventions. The Template for Intervention Description and Replication (TIDieR) was developed to specify the minimal intervention elements that should be reported.Objectives (1) To assess the extent to which outpatient pharmacy interventions were adequately reported. (2) To examine the dimension(s) across which reporting quality varies. (3) To examine trial characteristics that predict better reporting.Methods The sample comprised 86 randomised controlled trials identified in a Cochrane review of the effectiveness of pharmacist interventions on patient health outcomes. Duplicate, independent application of a modified 15-item TIDieR checklist was undertaken to assess the intervention reporting. The reporting/non-reporting of TIDieR items was analysed with principal component analysis to evaluate the dimensionality of reporting quality and regression analyses to assess predictors of reporting qualityResults In total, 422 (40%) TIDieR items were fully reported, 395 (38%) were partially reported and 231 (22%) were not reported. A further 242 items were deemed not applicable to the specific trials. Reporting quality loaded on one component which accounted for 26% of the variance in TIDieR scores. More recent trials reported a slightly greater number of TIDieR items (0.07 (95% CI 0.02 to 0.13) additional TIDieR items per year of publication). Trials reported an 0.09 (95% CI 0.04 to 0.14) additional TIDieR items per unit increase in impact factor (IF) of the journal in which the main report was published.Conclusions Most trials lacked adequate intervention reporting. This diminished the applied and scientific value of their research. The standard of intervention reporting is, however, gradually increasing and appears somewhat better in journals with higher IFs. The use of the TIDieR checklist to improve reporting could enhance the utility and replicability of trials, and reduce research waste.

AB - Introduction Scientific progress and translation of evidence into practice is impeded by poorly described interventions. The Template for Intervention Description and Replication (TIDieR) was developed to specify the minimal intervention elements that should be reported.Objectives (1) To assess the extent to which outpatient pharmacy interventions were adequately reported. (2) To examine the dimension(s) across which reporting quality varies. (3) To examine trial characteristics that predict better reporting.Methods The sample comprised 86 randomised controlled trials identified in a Cochrane review of the effectiveness of pharmacist interventions on patient health outcomes. Duplicate, independent application of a modified 15-item TIDieR checklist was undertaken to assess the intervention reporting. The reporting/non-reporting of TIDieR items was analysed with principal component analysis to evaluate the dimensionality of reporting quality and regression analyses to assess predictors of reporting qualityResults In total, 422 (40%) TIDieR items were fully reported, 395 (38%) were partially reported and 231 (22%) were not reported. A further 242 items were deemed not applicable to the specific trials. Reporting quality loaded on one component which accounted for 26% of the variance in TIDieR scores. More recent trials reported a slightly greater number of TIDieR items (0.07 (95% CI 0.02 to 0.13) additional TIDieR items per year of publication). Trials reported an 0.09 (95% CI 0.04 to 0.14) additional TIDieR items per unit increase in impact factor (IF) of the journal in which the main report was published.Conclusions Most trials lacked adequate intervention reporting. This diminished the applied and scientific value of their research. The standard of intervention reporting is, however, gradually increasing and appears somewhat better in journals with higher IFs. The use of the TIDieR checklist to improve reporting could enhance the utility and replicability of trials, and reduce research waste.

KW - checklist

KW - clinical trials as topic/standards

KW - pharmacy/standards

KW - reproducibility of results

KW - research report/standards

UR - http://www.scopus.com/inward/record.url?scp=85077045392&partnerID=8YFLogxK

U2 - 10.1136/bmjopen-2018-025511

DO - 10.1136/bmjopen-2018-025511

M3 - Article

C2 - 31862736

VL - 9

SP - e025511

JO - BMJ Open

JF - BMJ Open

SN - 2044-6055

IS - 12

M1 - e025511

ER -