Evaluating the efficacy of AI systems in diabetic retinopathy detection: A comparative analysis of Mona DR and IDx‐DR
Acta Ophthalmologica · 2025
DOI: 10.1111/aos.17428 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Acta Ophthalmologica, 2025. Verfasst von Andrzej Grzybowski und 7 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznan, Poland. Hauptthemen laut MEDLINE: Diabetic Retinopathy, Artificial Intelligence. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 32 Literaturangaben.
Abstract (Originalsprache)
Purpose
To compare two artificial intelligence (AI)‐based Automated Diabetic Retinopathy Image Assessment (ARIA) softwares in terms of concordance with specialist human graders and referable diabetic retinopathy (DR) diagnostic capacity.
Methods
Retrospective comparative study including 750 consecutive diabetes mellitus patients imaged for non‐mydriatic fundus photographs. For each patient four images (45 degrees field of view) were captured, centered on the optic disc and macula. Images were manually graded for severity of DR as no DR, any DR (mild non‐proliferative diabetic retinopathy [NPDR] or more), referable DR (RDR (more than mild DR)), or sight‐threatening DR (severe NPDR or more severe disease and/or clinically significant diabetic macular edema [CSDME]). IDx‐DR and MONA DR output was compared with manual grading and with each other.
Results
Total sample size was 750 patients, of which 55 were excluded due to ungradable images. Out of the remaining 695 patients 522 (75%) were considered as having no DR by manual consensus grading, and 106 (15%) as having RDR. Agreement between raters varied between moderate to substantial. IDx‐DR showed moderate agreement with human grading ( k = 0.4285) while MONA DR had substantial agreement ( k = 0.6797). Out of 106 patients with a ground truth of RDR, IDx‐DR identified 105 and MONA DR identified 99. The sensitivity and specificity rates for RDR detection of IDx‐DR were 99.1 and 71.5% compared with MONA DR of 93.4 and 89.3% respectively. Of note, both ARIAs had 100% sensitivity for the detection of STDR.
Conclusion
Both ARIAs performed well in this study population, both with sensitivity for RDR screening over 90%, with IDx‐DR showing higher sensitivity and MONA DR higher specificity. MONA DR showed superior agreement with human certified graders.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznan, Poland.
- Department of Ophthalmology, University Hospitals UZ Leuven, Leuven, Belgium.
- Department of Neurosciences, Research Group of Ophthalmology, Leuven, Belgium.
- Department of Ophthalmology, Hospital de Santa Maria, ULSSM, Lisbon, Portugal.
- Center for Visual Sciences Study, Faculty of Medicine, University of Lisbon, Lisbon, Portugal.
- Department of Ophthalmology, Poznan City Hospital, Poznan, Poland.
ORCID-Profile: Andrzej Grzybowski, Rafael Correia Barão, Ingeborg Stalmans
Zitieren
APA
Grzybowski, A., Peeters, F., Barão, R. C., Brona, P., Rommes, S., Krzywicki, T., Stalmans, I., & Jacob, J. (2025). Evaluating the efficacy of AI systems in diabetic retinopathy detection: A comparative analysis of Mona DR and IDx‐DR. Acta Ophthalmologica. https://doi.org/10.1111/aos.17428
Vancouver
Grzybowski A, Peeters F, Barão RC, Brona P, Rommes S, Krzywicki T, et al. Evaluating the efficacy of AI systems in diabetic retinopathy detection: A comparative analysis of Mona DR and IDx‐DR. Acta Ophthalmologica. 2025. doi:10.1111/aos.17428
BibTeX
@article{Grzybowski2025,
author = {Grzybowski, Andrzej and Peeters, Freya and Barão, Rafael Correia and Brona, Piotr and Rommes, Stef and Krzywicki, Tomasz and Stalmans, Ingeborg and Jacob, Julie},
title = {Evaluating the efficacy of AI systems in diabetic retinopathy detection: A comparative analysis of Mona DR and IDx‐DR},
journal = {Acta Ophthalmologica},
year = {2025},
doi = {10.1111/aos.17428}
}
EUVIMED