Reporting methodological search filter performance comparisons: a literature review

Jennifer Harbour, Cynthia Fraser, Carol Lefebvre, Julie Glanville, Sophie Beale, Charles Boachie, Steven Duffy, Rachael McCool, Lynne Smith

Research output: Contribution to journalArticle

13 Citations (Scopus)
4 Downloads (Pure)

Abstract

BACKGROUND: Methodological search filters are tools for retrieving database records reporting studies which use a specific research method. Choosing a filter is likely to be based on filter performance data. This review examines which measures are reported, and the way that filter performance is presented, in filter comparisons.

METHODS: Studies were identified from the current content and pending update (2010) of a filter website. Eligible studies compared two or more methodological search filters designed to identify randomised controlled trials, diagnostic test accuracy studies, systematic reviews or economic evaluations.

RESULTS: Eighteen studies met the inclusion criteria. The number of filters compared in a single study ranged from 2 to 38. The most commonly reported measures were sensitivity/recall and precision. All studies displayed results in tables and gave results as percentages or proportions. Two studies supplemented results tables with graphical displays of data: a bar graph of the proportion of retrieved and missed gold standard references per filter; a forest plot of the overall sensitivity and specificity of each filter.

CONCLUSIONS: Sensitivity/recall and precision are the most frequently reported performance measures. This review highlights the potential for presenting results in novel and innovative ways to aid filter selection.

Original languageEnglish
Pages (from-to)176-194
Number of pages19
JournalHealth Information & Libraries Journal
Volume31
Issue number3
Early online date1 Aug 2014
DOIs
Publication statusPublished - Sep 2014

    Fingerprint

Keywords

  • bibliographic databases
  • information storage and retrieval
  • methodological filters
  • precision
  • recall
  • review
  • literature

Cite this

Harbour, J., Fraser, C., Lefebvre, C., Glanville, J., Beale, S., Boachie, C., ... Smith, L. (2014). Reporting methodological search filter performance comparisons: a literature review. Health Information & Libraries Journal, 31(3), 176-194. https://doi.org/10.1111/hir.12070