The PRECIS-2 tool has good inter-rater reliability and modest discriminant validity

Kirsty Loudon (Corresponding Author), Merrick Zwarenstein, Frank Sullivan, Peter Donnan, Ildikó Gágyor, Hans Hobbelen, Fernando Althabe, Jerry A Krishnan, Shaun Treweek

Research output: Contribution to journalArticle

13 Citations (Scopus)
3 Downloads (Pure)

Abstract

• The original PRECIS tool did not have its validity and reliability formally measured.
• The inter-rater reliability of PRECIS-2 was measured using 19 raters (trialists from seven countries) to score a varied sample of 15 RCT protocols.
• Inter-rater reliability was generally good, with seven of nine domains having an Intraclass Correlation Coefficient over 0.65.
• Each of the nine PRECIS-2 domains could be used to differentiate between trials taking more pragmatic or more explanatory approaches with better than chance discrimination for all domains.
• The validity and reliability of PRECIS-2 has been assessed.
Original languageEnglish
Pages (from-to)113-121
Number of pages9
JournalJournal of Clinical Epidemiology
Volume88
Early online date8 Jun 2017
DOIs
Publication statusPublished - Aug 2017

Fingerprint

Reproducibility of Results

Keywords

  • randomized controlled trials
  • clinical trial methodology
  • validity and reliability
  • Face validity
  • trial design
  • Pragmatic clinical trial

Cite this

The PRECIS-2 tool has good inter-rater reliability and modest discriminant validity. / Loudon, Kirsty (Corresponding Author); Zwarenstein, Merrick; Sullivan, Frank; Donnan, Peter; Gágyor, Ildikó ; Hobbelen, Hans ; Althabe, Fernando ; Krishnan, Jerry A; Treweek, Shaun.

In: Journal of Clinical Epidemiology, Vol. 88, 08.2017, p. 113-121.

Research output: Contribution to journalArticle

Loudon, K, Zwarenstein, M, Sullivan, F, Donnan, P, Gágyor, I, Hobbelen, H, Althabe, F, Krishnan, JA & Treweek, S 2017, 'The PRECIS-2 tool has good inter-rater reliability and modest discriminant validity', Journal of Clinical Epidemiology, vol. 88, pp. 113-121. https://doi.org/10.1016/j.jclinepi.2017.06.001
Loudon, Kirsty ; Zwarenstein, Merrick ; Sullivan, Frank ; Donnan, Peter ; Gágyor, Ildikó ; Hobbelen, Hans ; Althabe, Fernando ; Krishnan, Jerry A ; Treweek, Shaun. / The PRECIS-2 tool has good inter-rater reliability and modest discriminant validity. In: Journal of Clinical Epidemiology. 2017 ; Vol. 88. pp. 113-121.
@article{4f240ea2348648d0b1fa45e2d21f569e,
title = "The PRECIS-2 tool has good inter-rater reliability and modest discriminant validity",
abstract = "• The original PRECIS tool did not have its validity and reliability formally measured.• The inter-rater reliability of PRECIS-2 was measured using 19 raters (trialists from seven countries) to score a varied sample of 15 RCT protocols. • Inter-rater reliability was generally good, with seven of nine domains having an Intraclass Correlation Coefficient over 0.65. • Each of the nine PRECIS-2 domains could be used to differentiate between trials taking more pragmatic or more explanatory approaches with better than chance discrimination for all domains. • The validity and reliability of PRECIS-2 has been assessed.",
keywords = "randomized controlled trials, clinical trial methodology, validity and reliability, Face validity , trial design, Pragmatic clinical trial",
author = "Kirsty Loudon and Merrick Zwarenstein and Frank Sullivan and Peter Donnan and Ildik{\'o} G{\'a}gyor and Hans Hobbelen and Fernando Althabe and Krishnan, {Jerry A} and Shaun Treweek",
note = "This work was supported by the Chief Scientist Office (CSO) of Scotland grant CZH/4/773, the UK Medical Research Council and the University of Dundee work through the provision of a stipend for KL and from the Health Services Research Unit at the University of Aberdeen, which is core funded by the CSO of the Scottish Government Health Directories. We are grateful to all the participants who assisted in this study: F Althabe, A-W Chan, D Altman, D Bratton, E Brass, M Campbell, G Forbes, B Gaglio, R Glasgow, H Hobbelen, S Hopewell, J Krishnan, D Riddle, J Segal, D Steinfort, P Tugwell, SN Van der Veer, VA. Welch, C Witt.",
year = "2017",
month = "8",
doi = "10.1016/j.jclinepi.2017.06.001",
language = "English",
volume = "88",
pages = "113--121",
journal = "Journal of Clinical Epidemiology",
issn = "0895-4356",
publisher = "Elsevier USA",

}

TY - JOUR

T1 - The PRECIS-2 tool has good inter-rater reliability and modest discriminant validity

AU - Loudon, Kirsty

AU - Zwarenstein, Merrick

AU - Sullivan, Frank

AU - Donnan, Peter

AU - Gágyor, Ildikó

AU - Hobbelen, Hans

AU - Althabe, Fernando

AU - Krishnan, Jerry A

AU - Treweek, Shaun

N1 - This work was supported by the Chief Scientist Office (CSO) of Scotland grant CZH/4/773, the UK Medical Research Council and the University of Dundee work through the provision of a stipend for KL and from the Health Services Research Unit at the University of Aberdeen, which is core funded by the CSO of the Scottish Government Health Directories. We are grateful to all the participants who assisted in this study: F Althabe, A-W Chan, D Altman, D Bratton, E Brass, M Campbell, G Forbes, B Gaglio, R Glasgow, H Hobbelen, S Hopewell, J Krishnan, D Riddle, J Segal, D Steinfort, P Tugwell, SN Van der Veer, VA. Welch, C Witt.

PY - 2017/8

Y1 - 2017/8

N2 - • The original PRECIS tool did not have its validity and reliability formally measured.• The inter-rater reliability of PRECIS-2 was measured using 19 raters (trialists from seven countries) to score a varied sample of 15 RCT protocols. • Inter-rater reliability was generally good, with seven of nine domains having an Intraclass Correlation Coefficient over 0.65. • Each of the nine PRECIS-2 domains could be used to differentiate between trials taking more pragmatic or more explanatory approaches with better than chance discrimination for all domains. • The validity and reliability of PRECIS-2 has been assessed.

AB - • The original PRECIS tool did not have its validity and reliability formally measured.• The inter-rater reliability of PRECIS-2 was measured using 19 raters (trialists from seven countries) to score a varied sample of 15 RCT protocols. • Inter-rater reliability was generally good, with seven of nine domains having an Intraclass Correlation Coefficient over 0.65. • Each of the nine PRECIS-2 domains could be used to differentiate between trials taking more pragmatic or more explanatory approaches with better than chance discrimination for all domains. • The validity and reliability of PRECIS-2 has been assessed.

KW - randomized controlled trials

KW - clinical trial methodology

KW - validity and reliability

KW - Face validity

KW - trial design

KW - Pragmatic clinical trial

U2 - 10.1016/j.jclinepi.2017.06.001

DO - 10.1016/j.jclinepi.2017.06.001

M3 - Article

VL - 88

SP - 113

EP - 121

JO - Journal of Clinical Epidemiology

JF - Journal of Clinical Epidemiology

SN - 0895-4356

ER -