Comparison between manual and semi-automated radiographic scoring in rheumatoid arthritis

Y. M. J. Lim, J. S. Gregory, R. J. Barr, N. Basu, K. Secombes, D. M. Reid

Research output: Contribution to journalAbstract

Abstract

Background: Rheumatoid arthritis is an inflammatory condition that results in joint damage. Sharp-van der Heidje is one of the most widely used scoring method in assessing damage in RA. The aim of this project was to compare scoring of hand radiographs manually with a semi-automated workflow tool in development.
Method and results: Twenty-one sets of bilateral hand radiographs from patients with RA of variable duration were scored both manually and with the semi-automated method in a randomised order twice, with the time taken for scoring recorded. A paired T-test for timing showed the semi-automated method to be faster by 2.6 and 1.4 min in both the first and second runs, respectively (P = 0.0019 and P = 0.0003). Bland and Altman testing showed only one outlier with the semi-automated method suggesting a good agreement between runs with insignificant loss in repeatability. However, the new method did not improve reproducibility with coefficient of variation of 21.05% and 17.14% for the two runs compared to manual scoring (14.64% and 16.44%). Concordance coefficient testing showed good repeatability for both methods for both erosions and joint space narrowing.
Conclusion: The new semi-automated scoring system has value in terms of speed of scoring radiographs with negligible loss in accuracy, precision, and reproducibility as compared to normal manual scoring. With further development, the method has the potential to be a valuable tool in improving efficiency of assessing hand radiographs.
Original languageEnglish
Pages (from-to)E30-E31
Number of pages2
JournalScottish Medical Journal
Volume60
Issue number3
DOIs
Publication statusPublished - Aug 2015

Cite this

Comparison between manual and semi-automated radiographic scoring in rheumatoid arthritis. / Lim, Y. M. J.; Gregory, J. S.; Barr, R. J.; Basu, N.; Secombes, K.; Reid, D. M.

In: Scottish Medical Journal, Vol. 60, No. 3, 08.2015, p. E30-E31.

Research output: Contribution to journalAbstract

Lim, Y. M. J. ; Gregory, J. S. ; Barr, R. J. ; Basu, N. ; Secombes, K. ; Reid, D. M. / Comparison between manual and semi-automated radiographic scoring in rheumatoid arthritis. In: Scottish Medical Journal. 2015 ; Vol. 60, No. 3. pp. E30-E31.
@article{6a0b0d6502674c11a7c5cf905633eee5,
title = "Comparison between manual and semi-automated radiographic scoring in rheumatoid arthritis",
abstract = "Background: Rheumatoid arthritis is an inflammatory condition that results in joint damage. Sharp-van der Heidje is one of the most widely used scoring method in assessing damage in RA. The aim of this project was to compare scoring of hand radiographs manually with a semi-automated workflow tool in development.Method and results: Twenty-one sets of bilateral hand radiographs from patients with RA of variable duration were scored both manually and with the semi-automated method in a randomised order twice, with the time taken for scoring recorded. A paired T-test for timing showed the semi-automated method to be faster by 2.6 and 1.4 min in both the first and second runs, respectively (P = 0.0019 and P = 0.0003). Bland and Altman testing showed only one outlier with the semi-automated method suggesting a good agreement between runs with insignificant loss in repeatability. However, the new method did not improve reproducibility with coefficient of variation of 21.05{\%} and 17.14{\%} for the two runs compared to manual scoring (14.64{\%} and 16.44{\%}). Concordance coefficient testing showed good repeatability for both methods for both erosions and joint space narrowing.Conclusion: The new semi-automated scoring system has value in terms of speed of scoring radiographs with negligible loss in accuracy, precision, and reproducibility as compared to normal manual scoring. With further development, the method has the potential to be a valuable tool in improving efficiency of assessing hand radiographs.",
author = "Lim, {Y. M. J.} and Gregory, {J. S.} and Barr, {R. J.} and N. Basu and K. Secombes and Reid, {D. M.}",
year = "2015",
month = "8",
doi = "10.1177/0036933015577771",
language = "English",
volume = "60",
pages = "E30--E31",
journal = "Scottish Medical Journal",
issn = "0036-9330",
publisher = "SAGE PUBLICATIONS LTD",
number = "3",

}

TY - JOUR

T1 - Comparison between manual and semi-automated radiographic scoring in rheumatoid arthritis

AU - Lim, Y. M. J.

AU - Gregory, J. S.

AU - Barr, R. J.

AU - Basu, N.

AU - Secombes, K.

AU - Reid, D. M.

PY - 2015/8

Y1 - 2015/8

N2 - Background: Rheumatoid arthritis is an inflammatory condition that results in joint damage. Sharp-van der Heidje is one of the most widely used scoring method in assessing damage in RA. The aim of this project was to compare scoring of hand radiographs manually with a semi-automated workflow tool in development.Method and results: Twenty-one sets of bilateral hand radiographs from patients with RA of variable duration were scored both manually and with the semi-automated method in a randomised order twice, with the time taken for scoring recorded. A paired T-test for timing showed the semi-automated method to be faster by 2.6 and 1.4 min in both the first and second runs, respectively (P = 0.0019 and P = 0.0003). Bland and Altman testing showed only one outlier with the semi-automated method suggesting a good agreement between runs with insignificant loss in repeatability. However, the new method did not improve reproducibility with coefficient of variation of 21.05% and 17.14% for the two runs compared to manual scoring (14.64% and 16.44%). Concordance coefficient testing showed good repeatability for both methods for both erosions and joint space narrowing.Conclusion: The new semi-automated scoring system has value in terms of speed of scoring radiographs with negligible loss in accuracy, precision, and reproducibility as compared to normal manual scoring. With further development, the method has the potential to be a valuable tool in improving efficiency of assessing hand radiographs.

AB - Background: Rheumatoid arthritis is an inflammatory condition that results in joint damage. Sharp-van der Heidje is one of the most widely used scoring method in assessing damage in RA. The aim of this project was to compare scoring of hand radiographs manually with a semi-automated workflow tool in development.Method and results: Twenty-one sets of bilateral hand radiographs from patients with RA of variable duration were scored both manually and with the semi-automated method in a randomised order twice, with the time taken for scoring recorded. A paired T-test for timing showed the semi-automated method to be faster by 2.6 and 1.4 min in both the first and second runs, respectively (P = 0.0019 and P = 0.0003). Bland and Altman testing showed only one outlier with the semi-automated method suggesting a good agreement between runs with insignificant loss in repeatability. However, the new method did not improve reproducibility with coefficient of variation of 21.05% and 17.14% for the two runs compared to manual scoring (14.64% and 16.44%). Concordance coefficient testing showed good repeatability for both methods for both erosions and joint space narrowing.Conclusion: The new semi-automated scoring system has value in terms of speed of scoring radiographs with negligible loss in accuracy, precision, and reproducibility as compared to normal manual scoring. With further development, the method has the potential to be a valuable tool in improving efficiency of assessing hand radiographs.

U2 - 10.1177/0036933015577771

DO - 10.1177/0036933015577771

M3 - Abstract

VL - 60

SP - E30-E31

JO - Scottish Medical Journal

JF - Scottish Medical Journal

SN - 0036-9330

IS - 3

ER -