Costs and consequences of automated algorithms versus manual grading for the detection of referable diabetic retinopathy

G. S. Scotland*, P. McNamee, A. D. Fleming, K. A. Goatman, S. Philip, G. J. Prescott, P. F. Sharp, G. J. Williams, W. Wykes, G. P. Leese, J. A. Olson, Scottish Diabetic Retinopathy Clin

*Corresponding author for this work

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

Aims To assess the cost-effectiveness of an improved automated grading algorithm for diabetic retinopathy against a previously described algorithm, and in comparison with manual grading.

Methods Efficacy of the alternative algorithms was assessed using a reference graded set of images from three screening centres in Scotland (1253 cases with observable/referable retinopathy and 6333 individuals with mild or no retinopathy). Screening outcomes and grading and diagnosis costs were modelled for a cohort of 180 000 people, with prevalence of referable retinopathy at 4%. Algorithm (b), which combines image quality assessment with detection algorithms for microaneurysms (MA), blot haemorrhages and exudates, was compared with a simpler algorithm (a) (using image quality assessment and MA/dot haemorrhage (DH) detection), and the current practice of manual grading.

Results Compared with algorithm (a), algorithm (b) would identify an additional 113 cases of referable retinopathy for an incremental cost of 68 pound per additional case. Compared with manual grading, automated grading would be expected to identify between 54 and 123 fewer referable cases, for a grading cost saving between 3834 pound and 1727 pound per case missed. Extrapolation modelling over a 20-year time horizon suggests manual grading would cost between 25 pound 676 and 267 pound 115 per additional quality adjusted life year gained.

Conclusions Algorithm (b) is more cost-effective than the algorithm based on quality assessment and MA/DH detection. With respect to the value of introducing automated detection systems into screening programmes, automated grading operates within the recommended national standards in Scotland and is likely to be considered a cost-effective alternative to manual disease/no disease grading.

Original languageEnglish
Pages (from-to)712-719
Number of pages8
JournalBritish Journal of Ophthalmology
Volume94
Issue number6
Early online date3 Dec 2009
DOIs
Publication statusPublished - Jun 2010

Keywords

  • Algorithms
  • Cost-Benefit Analysis
  • Decision Trees
  • Diabetic Retinopathy
  • Diagnosis, Computer-Assisted
  • Diagnostic Techniques, Ophthalmological
  • Exudates and Transudates
  • Health Care Costs
  • Humans
  • Image Interpretation, Computer-Assisted
  • Mass Screening
  • Quality-Adjusted Life Years
  • Retinal Hemorrhage
  • Scotland
  • Severity of Illness Index
  • Screening Program
  • Disease

Fingerprint Dive into the research topics of 'Costs and consequences of automated algorithms versus manual grading for the detection of referable diabetic retinopathy'. Together they form a unique fingerprint.

  • Cite this

    Scotland, G. S., McNamee, P., Fleming, A. D., Goatman, K. A., Philip, S., Prescott, G. J., Sharp, P. F., Williams, G. J., Wykes, W., Leese, G. P., Olson, J. A., & Scottish Diabetic Retinopathy Clin (2010). Costs and consequences of automated algorithms versus manual grading for the detection of referable diabetic retinopathy. British Journal of Ophthalmology, 94(6), 712-719. https://doi.org/10.1136/bjo.2008.151126