TY - JOUR
T1 - Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging
AU - Kurvers, Ralf H J M
AU - de Zoete, Annemarie
AU - Bachman, Shelby L
AU - Algra, Paul R
AU - Ostelo, Raymond
PY - 2018/4/3
Y1 - 2018/4/3
N2 - Diagnosing the causes of low back pain is a challenging task, prone to errors. A novel approach to increase diagnostic accuracy in medical decision making is collective intelligence, which refers to the ability of groups to outperform individual decision makers in solving problems. We investigated whether combining the independent ratings of chiropractors, chiropractic radiologists and medical radiologists can improve diagnostic accuracy when interpreting diagnostic images of the lumbosacral spine. Evaluations were obtained from two previously published studies: study 1 consisted of 13 raters independently rating 300 lumbosacral radiographs; study 2 consisted of 14 raters independently rating 100 lumbosacral magnetic resonance images. In both studies, raters evaluated the presence of "abnormalities", which are indicators of a serious health risk and warrant immediate further examination. We combined independent decisions of raters using a majority rule which takes as final diagnosis the decision of the majority of the group. We compared the performance of the majority rule to the performance of single raters. Our results show that with increasing group size (i.e., increasing the number of independent decisions) both sensitivity and specificity increased in both data-sets, with groups consistently outperforming single raters. These results were found for radiographs and MR image reading alike. Our findings suggest that combining independent ratings can improve the accuracy of lumbosacral diagnostic image reading.
AB - Diagnosing the causes of low back pain is a challenging task, prone to errors. A novel approach to increase diagnostic accuracy in medical decision making is collective intelligence, which refers to the ability of groups to outperform individual decision makers in solving problems. We investigated whether combining the independent ratings of chiropractors, chiropractic radiologists and medical radiologists can improve diagnostic accuracy when interpreting diagnostic images of the lumbosacral spine. Evaluations were obtained from two previously published studies: study 1 consisted of 13 raters independently rating 300 lumbosacral radiographs; study 2 consisted of 14 raters independently rating 100 lumbosacral magnetic resonance images. In both studies, raters evaluated the presence of "abnormalities", which are indicators of a serious health risk and warrant immediate further examination. We combined independent decisions of raters using a majority rule which takes as final diagnosis the decision of the majority of the group. We compared the performance of the majority rule to the performance of single raters. Our results show that with increasing group size (i.e., increasing the number of independent decisions) both sensitivity and specificity increased in both data-sets, with groups consistently outperforming single raters. These results were found for radiographs and MR image reading alike. Our findings suggest that combining independent ratings can improve the accuracy of lumbosacral diagnostic image reading.
KW - Algorithms
KW - Clinical Decision-Making/methods
KW - Humans
KW - Image Processing, Computer-Assisted
KW - Lumbosacral Region/diagnostic imaging
KW - Magnetic Resonance Imaging/methods
KW - Radiography/methods
KW - Reproducibility of Results
KW - Sample Size
KW - Sensitivity and Specificity
KW - Workflow
UR - http://www.scopus.com/inward/record.url?scp=85044868723&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85044868723&partnerID=8YFLogxK
U2 - 10.1371/journal.pone.0194128
DO - 10.1371/journal.pone.0194128
M3 - Article
C2 - 29614070
AN - SCOPUS:85044868723
SN - 1932-6203
VL - 13
SP - 1
EP - 17
JO - PLoS ONE
JF - PLoS ONE
IS - 4
M1 - e0194128
ER -