Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated?

P. G. Shekelle, E. Ortiz, Scott Walton Rhodes, S. C. Morton, M. P. Eccles, S. H. Woolf

Research output: Contribution to journalArticle

392 Citations (Scopus)

Abstract

Context Practice guidelines need to be up-to-date to be useful to clinicians. No published methods are available for assessing whether existing practice guidelines are still valid, nor does any empirical information exist regarding how often such assessments need to be made.

Objectives To assess the current validity of 17 clinical practice guidelines published by the US Agency for Healthcare Research and Quality (AHRQ) that are still in circulation, and to use this information to estimate how quickly guidelines become obsolete.

Design, Setting, and Participants We developed criteria for defining when a guideline needs updating, mailed surveys to members of the original AHRQ guideline panels (n = 170; response rate, 71%), and searched the literature for evidence through March 2000 (n = 6994 titles yielding 173 articles plus 159 new guidelines on the same topics).

Main Outcome Measures Identification of new evidence calling for a major, minor, or no update of the 17 guidelines; survival analysis of the rate at which guidelines became outdated.

Results For 7 guidelines, new evidence and expert judgment indicated that a major update is required; 6 were found to be in need of a minor update; 3 were judged as still valid; and for 1 guideline, we could reach no conclusion. Survival analysis indicated that about half the guidelines were outdated in 5.8 years (95% confidence interval [CI], 5.0-6.6 years). The point at which no more than 90% of the guidelines were still valid was 3.6 years (95% CI, 2.6-4.6 years).

Conclusions More than three quarters of the AHRQ guidelines need updating. As a general rule, guidelines should be reassessed for validity every 3 years.

Original languageEnglish
Pages (from-to)1461-1467
Number of pages6
JournalJAMA
Volume286
Issue number12
DOIs
Publication statusPublished - 2001

Cite this

Shekelle, P. G., Ortiz, E., Rhodes, S. W., Morton, S. C., Eccles, M. P., & Woolf, S. H. (2001). Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated? JAMA, 286(12), 1461-1467. https://doi.org/10.1001/jama.286.12.1461

Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated? / Shekelle, P. G.; Ortiz, E.; Rhodes, Scott Walton; Morton, S. C.; Eccles, M. P.; Woolf, S. H.

In: JAMA, Vol. 286, No. 12, 2001, p. 1461-1467.

Research output: Contribution to journalArticle

Shekelle, P. G. ; Ortiz, E. ; Rhodes, Scott Walton ; Morton, S. C. ; Eccles, M. P. ; Woolf, S. H. / Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated?. In: JAMA. 2001 ; Vol. 286, No. 12. pp. 1461-1467.
@article{1fef566a952c420b838939a99f3011e3,
title = "Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated?",
abstract = "Context Practice guidelines need to be up-to-date to be useful to clinicians. No published methods are available for assessing whether existing practice guidelines are still valid, nor does any empirical information exist regarding how often such assessments need to be made.Objectives To assess the current validity of 17 clinical practice guidelines published by the US Agency for Healthcare Research and Quality (AHRQ) that are still in circulation, and to use this information to estimate how quickly guidelines become obsolete.Design, Setting, and Participants We developed criteria for defining when a guideline needs updating, mailed surveys to members of the original AHRQ guideline panels (n = 170; response rate, 71{\%}), and searched the literature for evidence through March 2000 (n = 6994 titles yielding 173 articles plus 159 new guidelines on the same topics).Main Outcome Measures Identification of new evidence calling for a major, minor, or no update of the 17 guidelines; survival analysis of the rate at which guidelines became outdated.Results For 7 guidelines, new evidence and expert judgment indicated that a major update is required; 6 were found to be in need of a minor update; 3 were judged as still valid; and for 1 guideline, we could reach no conclusion. Survival analysis indicated that about half the guidelines were outdated in 5.8 years (95{\%} confidence interval [CI], 5.0-6.6 years). The point at which no more than 90{\%} of the guidelines were still valid was 3.6 years (95{\%} CI, 2.6-4.6 years).Conclusions More than three quarters of the AHRQ guidelines need updating. As a general rule, guidelines should be reassessed for validity every 3 years.",
author = "Shekelle, {P. G.} and E. Ortiz and Rhodes, {Scott Walton} and Morton, {S. C.} and Eccles, {M. P.} and Woolf, {S. H.}",
year = "2001",
doi = "10.1001/jama.286.12.1461",
language = "English",
volume = "286",
pages = "1461--1467",
journal = "JAMA",
issn = "0098-7484",
publisher = "American Medical Association",
number = "12",

}

TY - JOUR

T1 - Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated?

AU - Shekelle, P. G.

AU - Ortiz, E.

AU - Rhodes, Scott Walton

AU - Morton, S. C.

AU - Eccles, M. P.

AU - Woolf, S. H.

PY - 2001

Y1 - 2001

N2 - Context Practice guidelines need to be up-to-date to be useful to clinicians. No published methods are available for assessing whether existing practice guidelines are still valid, nor does any empirical information exist regarding how often such assessments need to be made.Objectives To assess the current validity of 17 clinical practice guidelines published by the US Agency for Healthcare Research and Quality (AHRQ) that are still in circulation, and to use this information to estimate how quickly guidelines become obsolete.Design, Setting, and Participants We developed criteria for defining when a guideline needs updating, mailed surveys to members of the original AHRQ guideline panels (n = 170; response rate, 71%), and searched the literature for evidence through March 2000 (n = 6994 titles yielding 173 articles plus 159 new guidelines on the same topics).Main Outcome Measures Identification of new evidence calling for a major, minor, or no update of the 17 guidelines; survival analysis of the rate at which guidelines became outdated.Results For 7 guidelines, new evidence and expert judgment indicated that a major update is required; 6 were found to be in need of a minor update; 3 were judged as still valid; and for 1 guideline, we could reach no conclusion. Survival analysis indicated that about half the guidelines were outdated in 5.8 years (95% confidence interval [CI], 5.0-6.6 years). The point at which no more than 90% of the guidelines were still valid was 3.6 years (95% CI, 2.6-4.6 years).Conclusions More than three quarters of the AHRQ guidelines need updating. As a general rule, guidelines should be reassessed for validity every 3 years.

AB - Context Practice guidelines need to be up-to-date to be useful to clinicians. No published methods are available for assessing whether existing practice guidelines are still valid, nor does any empirical information exist regarding how often such assessments need to be made.Objectives To assess the current validity of 17 clinical practice guidelines published by the US Agency for Healthcare Research and Quality (AHRQ) that are still in circulation, and to use this information to estimate how quickly guidelines become obsolete.Design, Setting, and Participants We developed criteria for defining when a guideline needs updating, mailed surveys to members of the original AHRQ guideline panels (n = 170; response rate, 71%), and searched the literature for evidence through March 2000 (n = 6994 titles yielding 173 articles plus 159 new guidelines on the same topics).Main Outcome Measures Identification of new evidence calling for a major, minor, or no update of the 17 guidelines; survival analysis of the rate at which guidelines became outdated.Results For 7 guidelines, new evidence and expert judgment indicated that a major update is required; 6 were found to be in need of a minor update; 3 were judged as still valid; and for 1 guideline, we could reach no conclusion. Survival analysis indicated that about half the guidelines were outdated in 5.8 years (95% confidence interval [CI], 5.0-6.6 years). The point at which no more than 90% of the guidelines were still valid was 3.6 years (95% CI, 2.6-4.6 years).Conclusions More than three quarters of the AHRQ guidelines need updating. As a general rule, guidelines should be reassessed for validity every 3 years.

U2 - 10.1001/jama.286.12.1461

DO - 10.1001/jama.286.12.1461

M3 - Article

VL - 286

SP - 1461

EP - 1467

JO - JAMA

JF - JAMA

SN - 0098-7484

IS - 12

ER -