Developing a sensitive search strategy in MEDLINE to retrieve studies on assessment of the diagnostic performance of Imaging techniques

Margaret P Astin, Miriam Giovanna Brazzelli, Cynthia Mary Fraser, Carl Edward Counsell, Gillian Needham, Jeremy M. Grimshaw

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Purpose: To prospectively develop a search strategy in MEDLINE for identifying studies on the diagnostic performance of any imaging modality, with maximized and minimized retrieval of relevant and irrelevant studies, respectively.

Materials and Methods: Predefined inclusion criteria were used to conduct a hand search of two sets of radiologic journal articles for studies on assessment of the diagnostic performance of imaging techniques. These two sets of articles formed independent derivation and validation record sets for developing and evaluating the search strategy. The sensitivity and positive predictive values (PPVs) of search terms from the derivation reference-standard set of records were used to select terms and develop two components of the search strategy. The first component was used to identify any study ( from the imaging literature) in which diagnostic test performance was assessed. The second component was used to identify studies of any imaging modality. The two components were combined in the final search strategy. The sensitivity, specificity, and PPV of the search strategy in the derivation and validation record sets were calculated.

Results: The final search strategy had a sensitivity of 92.8%, a specificity of 58.5%, and a PPV of 25.1% for retrieval of the derivation set of records. Validation with an independent set of records gave a sensitivity of 91.9% (95% confidence interval [CI]: 87.1%, 95.1%), a specificity of 52.2% (95% CI: 49.2%, 55.2%), and a PPV of 25.1% (95% CI: 22.0%, 28.5%). Removal of irrelevant publication types further improved specificity and PPV in the validation set: to 77.6% (95% CI: 75.0%, 80.0%) and 40.9% (95% CI: 36.2%, 45.7%), respectively. The volume of imaging literature retrieved from MEDLINE by using the described search strategy has tripled since 1975.

Conclusion: A sensitive search strategy to identify studies of the diagnostic performance of any imaging test was developed and validated. The retrieval estimates of this strategy in MEDLINE are adequate to develop a register of studies.

Original languageEnglish
Pages (from-to)365-373
Number of pages9
JournalRadiology
Volume247
Issue number2
DOIs
Publication statusPublished - May 2008

Keywords

  • medical literature
  • users guides
  • example
  • article
  • tests

Cite this

Developing a sensitive search strategy in MEDLINE to retrieve studies on assessment of the diagnostic performance of Imaging techniques. / Astin, Margaret P; Brazzelli, Miriam Giovanna; Fraser, Cynthia Mary; Counsell, Carl Edward; Needham, Gillian; Grimshaw, Jeremy M.

In: Radiology, Vol. 247, No. 2, 05.2008, p. 365-373.

Research output: Contribution to journalArticle

@article{920070b6251e4a078a9cecdd55868032,
title = "Developing a sensitive search strategy in MEDLINE to retrieve studies on assessment of the diagnostic performance of Imaging techniques",
abstract = "Purpose: To prospectively develop a search strategy in MEDLINE for identifying studies on the diagnostic performance of any imaging modality, with maximized and minimized retrieval of relevant and irrelevant studies, respectively.Materials and Methods: Predefined inclusion criteria were used to conduct a hand search of two sets of radiologic journal articles for studies on assessment of the diagnostic performance of imaging techniques. These two sets of articles formed independent derivation and validation record sets for developing and evaluating the search strategy. The sensitivity and positive predictive values (PPVs) of search terms from the derivation reference-standard set of records were used to select terms and develop two components of the search strategy. The first component was used to identify any study ( from the imaging literature) in which diagnostic test performance was assessed. The second component was used to identify studies of any imaging modality. The two components were combined in the final search strategy. The sensitivity, specificity, and PPV of the search strategy in the derivation and validation record sets were calculated.Results: The final search strategy had a sensitivity of 92.8{\%}, a specificity of 58.5{\%}, and a PPV of 25.1{\%} for retrieval of the derivation set of records. Validation with an independent set of records gave a sensitivity of 91.9{\%} (95{\%} confidence interval [CI]: 87.1{\%}, 95.1{\%}), a specificity of 52.2{\%} (95{\%} CI: 49.2{\%}, 55.2{\%}), and a PPV of 25.1{\%} (95{\%} CI: 22.0{\%}, 28.5{\%}). Removal of irrelevant publication types further improved specificity and PPV in the validation set: to 77.6{\%} (95{\%} CI: 75.0{\%}, 80.0{\%}) and 40.9{\%} (95{\%} CI: 36.2{\%}, 45.7{\%}), respectively. The volume of imaging literature retrieved from MEDLINE by using the described search strategy has tripled since 1975.Conclusion: A sensitive search strategy to identify studies of the diagnostic performance of any imaging test was developed and validated. The retrieval estimates of this strategy in MEDLINE are adequate to develop a register of studies.",
keywords = "medical literature, users guides, example, article, tests",
author = "Astin, {Margaret P} and Brazzelli, {Miriam Giovanna} and Fraser, {Cynthia Mary} and Counsell, {Carl Edward} and Gillian Needham and Grimshaw, {Jeremy M.}",
year = "2008",
month = "5",
doi = "10.1148/radiol.2472070101",
language = "English",
volume = "247",
pages = "365--373",
journal = "Radiology",
issn = "0033-8419",
publisher = "Radiological Society of North America Inc.",
number = "2",

}

TY - JOUR

T1 - Developing a sensitive search strategy in MEDLINE to retrieve studies on assessment of the diagnostic performance of Imaging techniques

AU - Astin, Margaret P

AU - Brazzelli, Miriam Giovanna

AU - Fraser, Cynthia Mary

AU - Counsell, Carl Edward

AU - Needham, Gillian

AU - Grimshaw, Jeremy M.

PY - 2008/5

Y1 - 2008/5

N2 - Purpose: To prospectively develop a search strategy in MEDLINE for identifying studies on the diagnostic performance of any imaging modality, with maximized and minimized retrieval of relevant and irrelevant studies, respectively.Materials and Methods: Predefined inclusion criteria were used to conduct a hand search of two sets of radiologic journal articles for studies on assessment of the diagnostic performance of imaging techniques. These two sets of articles formed independent derivation and validation record sets for developing and evaluating the search strategy. The sensitivity and positive predictive values (PPVs) of search terms from the derivation reference-standard set of records were used to select terms and develop two components of the search strategy. The first component was used to identify any study ( from the imaging literature) in which diagnostic test performance was assessed. The second component was used to identify studies of any imaging modality. The two components were combined in the final search strategy. The sensitivity, specificity, and PPV of the search strategy in the derivation and validation record sets were calculated.Results: The final search strategy had a sensitivity of 92.8%, a specificity of 58.5%, and a PPV of 25.1% for retrieval of the derivation set of records. Validation with an independent set of records gave a sensitivity of 91.9% (95% confidence interval [CI]: 87.1%, 95.1%), a specificity of 52.2% (95% CI: 49.2%, 55.2%), and a PPV of 25.1% (95% CI: 22.0%, 28.5%). Removal of irrelevant publication types further improved specificity and PPV in the validation set: to 77.6% (95% CI: 75.0%, 80.0%) and 40.9% (95% CI: 36.2%, 45.7%), respectively. The volume of imaging literature retrieved from MEDLINE by using the described search strategy has tripled since 1975.Conclusion: A sensitive search strategy to identify studies of the diagnostic performance of any imaging test was developed and validated. The retrieval estimates of this strategy in MEDLINE are adequate to develop a register of studies.

AB - Purpose: To prospectively develop a search strategy in MEDLINE for identifying studies on the diagnostic performance of any imaging modality, with maximized and minimized retrieval of relevant and irrelevant studies, respectively.Materials and Methods: Predefined inclusion criteria were used to conduct a hand search of two sets of radiologic journal articles for studies on assessment of the diagnostic performance of imaging techniques. These two sets of articles formed independent derivation and validation record sets for developing and evaluating the search strategy. The sensitivity and positive predictive values (PPVs) of search terms from the derivation reference-standard set of records were used to select terms and develop two components of the search strategy. The first component was used to identify any study ( from the imaging literature) in which diagnostic test performance was assessed. The second component was used to identify studies of any imaging modality. The two components were combined in the final search strategy. The sensitivity, specificity, and PPV of the search strategy in the derivation and validation record sets were calculated.Results: The final search strategy had a sensitivity of 92.8%, a specificity of 58.5%, and a PPV of 25.1% for retrieval of the derivation set of records. Validation with an independent set of records gave a sensitivity of 91.9% (95% confidence interval [CI]: 87.1%, 95.1%), a specificity of 52.2% (95% CI: 49.2%, 55.2%), and a PPV of 25.1% (95% CI: 22.0%, 28.5%). Removal of irrelevant publication types further improved specificity and PPV in the validation set: to 77.6% (95% CI: 75.0%, 80.0%) and 40.9% (95% CI: 36.2%, 45.7%), respectively. The volume of imaging literature retrieved from MEDLINE by using the described search strategy has tripled since 1975.Conclusion: A sensitive search strategy to identify studies of the diagnostic performance of any imaging test was developed and validated. The retrieval estimates of this strategy in MEDLINE are adequate to develop a register of studies.

KW - medical literature

KW - users guides

KW - example

KW - article

KW - tests

U2 - 10.1148/radiol.2472070101

DO - 10.1148/radiol.2472070101

M3 - Article

VL - 247

SP - 365

EP - 373

JO - Radiology

JF - Radiology

SN - 0033-8419

IS - 2

ER -