Multicenter Validation of Deep Learning Algorithm ROP.AI for the Automated Diagnosis of Plus Disease in ROP
Translational Vision Science & Technology · 2023
DOI: 10.1167/tvst.12.8.13 ↗Kurz gefasst
Multizentrische Studie in der Zeitschrift Translational Vision Science & Technology, 2023. Verfasst von Amelia Bai und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ophthalmology, Queensland Children's Hospital, South Brisbane, Queensland, Australia. Hauptthemen laut MEDLINE: Deep Learning, Retinopathy of Prematurity. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Purpose
Retinopathy of prematurity (ROP) is a sight-threatening vasoproliferative retinal disease affecting premature infants. The detection of plus disease, a severe form of ROP requiring treatment, remains challenging owing to subjectivity, frequency, and time intensity of retinal examinations. Recent artificial intelligence (AI) algorithms developed to detect plus disease aims to alleviate these challenges; however, they have not been tested against a diverse neonatal population. Our study aims to validate ROP.AI, an AI algorithm developed from a single cohort, against a multicenter Australian cohort to determine its performance in detecting plus disease.
Methods
Retinal images captured during routine ROP screening from May 2021 to February 2022 across five major tertiary centers throughout Australia were collected and uploaded to ROP.AI. AI diagnostic output was compared with one of five ROP experts. Sensitivity, specificity, negative predictive value, and area under the receiver operator curve were determined.
Results
We collected 8052 images. The area under the receiver operator curve for the diagnosis of plus disease was 0.75. ROP.AI achieved 84% sensitivity, 43% specificity, and 96% negative predictive value for the detection of plus disease after operating point optimization.
Conclusions
ROP.AI was able to detect plus disease in an external, multicenter cohort despite being trained from a single center. Algorithm performance was demonstrated without preprocessing or augmentation, simulating real-world clinical applicability. Further training may improve generalizability for clinical implementation. Translational Relevance: These results demonstrate ROP.AI's potential as a screening tool for the detection of plus disease in future clinical practice and provides a solution to overcome current diagnostic challenges.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Ophthalmology, Queensland Children's Hospital, South Brisbane, Queensland, Australia.
- Centre for Children's Health Research, South Brisbane, Queensland, Australia.
- School of Medical Science, Griffith University, Southport, Queensland, Australia.
- University of Queensland, St Lucia, Queensland, Australia.
- Department of Ophthalmology, Gold Coast University Hospital, Southport, Queensland, Australia.
- Bond University, Robina, Queensland, Australia.
Zitieren
APA
Bai, A., Dai, S., Hung, J., Kirpalani, A., Russell, H., Elder, J., Shah, S., Carty, C., & Tan, Z. (2023). Multicenter Validation of Deep Learning Algorithm ROP.AI for the Automated Diagnosis of Plus Disease in ROP. Translational Vision Science & Technology. https://doi.org/10.1167/tvst.12.8.13
Vancouver
Bai A, Dai S, Hung J, Kirpalani A, Russell H, Elder J, et al. Multicenter Validation of Deep Learning Algorithm ROP.AI for the Automated Diagnosis of Plus Disease in ROP. Translational Vision Science & Technology. 2023. doi:10.1167/tvst.12.8.13
BibTeX
@article{Bai2023,
author = {Bai, Amelia and Dai, Shuan and Hung, Jacky and Kirpalani, Aditi and Russell, Heather and Elder, James and Shah, Shaheen and Carty, Christopher and Tan, Zachary},
title = {Multicenter Validation of Deep Learning Algorithm ROP.AI for the Automated Diagnosis of Plus Disease in ROP},
journal = {Translational Vision Science & Technology},
year = {2023},
doi = {10.1167/tvst.12.8.13}
}
EUVIMED