Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy
Journal of Medical Internet Research · 29.11.2023 · 25 · e48142
DOI: 10.2196/48142 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 29.11.2023. Verfasst von Jeewoo Yoon und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Applied Artificial Intelligence, Sungkyunkwan University, Seoul, Republic of Korea. Hauptthemen laut MEDLINE: Central Serous Chorioretinopathy, Diagnosis, Computer-Assisted. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Although previous research has made substantial progress in developing high-performance artificial intelligence (AI)–based computer-aided diagnosis (AI-CAD) systems in various medical domains, little attention has been paid to developing and evaluating AI-CAD system in ophthalmology, particularly for diagnosing retinal diseases using optical coherence tomography (OCT) images.
Objective
This diagnostic study aimed to determine the usefulness of a proposed AI-CAD system in assisting ophthalmologists with the diagnosis of central serous chorioretinopathy (CSC), which is known to be difficult to diagnose, using OCT images.
Methods
For the training and evaluation of the proposed deep learning model, 1693 OCT images were collected and annotated. The data set included 929 and 764 cases of acute and chronic CSC, respectively. In total, 66 ophthalmologists (2 groups: 36 retina and 30 nonretina specialists) participated in the observer performance test. To evaluate the deep learning algorithm used in the proposed AI-CAD system, the training, validation, and test sets were split in an 8:1:1 ratio. Further, 100 randomly sampled OCT images from the test set were used for the observer performance test, and the participants were instructed to select a CSC subtype for each of these images. Each image was provided under different conditions: (1) without AI assistance, (2) with AI assistance with a probability score, and (3) with AI assistance with a probability score and visual evidence heatmap. The sensitivity, specificity, and area under the receiver operating characteristic curve were used to measure the diagnostic performance of the model and ophthalmologists.
Results
The proposed system achieved a high detection performance (99% of the area under the curve) for CSC, outperforming the 66 ophthalmologists who participated in the observer performance test. In both groups, ophthalmologists with the support of AI assistance with a probability score and visual evidence heatmap achieved the highest mean diagnostic performance compared with that of those subjected to other conditions (without AI assistance or with AI assistance with a probability score). Nonretina specialists achieved expert-level diagnostic performance with the support of the proposed AI-CAD system.
Conclusions
Our proposed AI-CAD system improved the diagnosis of CSC by ophthalmologists, which may support decision-making regarding retinal disease detection and alleviate the workload of ophthalmologists.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Applied Artificial Intelligence, Sungkyunkwan University, Seoul, Republic of Korea.
- Raondata, Seoul, Republic of Korea.
- Department of Human-Artificial Intelligence Interaction, Sungkyunkwan University, Seoul, Republic of Korea.
- Department of Medicine, Kangwon National University School of Medicine, Kangwon National University Hospital, Chuncheon, Republic of Korea.
- Seoul Plus Eye Clinic, Seoul, Republic of Korea.
- Seoul Bombit Eye Clinic, Sejong, Republic of Korea.
ORCID-Profile: Jeewoo Yoon, Jinyoung Han, Junseo Ko, Seong Choi, Ji In Park, Joon Seo Hwang, Jeong Mo Han, Daniel Duck-Jin Hwang
Zitieren
APA
Yoon, J., Han, J., Ko, J., Choi, S., Park, J. I., Hwang, J. S., Han, J. M., & Hwang, D. D. (2023). Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy. Journal of Medical Internet Research, 25, e48142. https://doi.org/10.2196/48142
Vancouver
Yoon J, Han J, Ko J, Choi S, Park JI, Hwang JS, et al. Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy. Journal of Medical Internet Research. 2023;25:e48142. doi:10.2196/48142
BibTeX
@article{Yoon2023,
author = {Yoon, Jeewoo and Han, Jinyoung and Ko, Junseo and Choi, Seong and Park, Ji In and Hwang, Joon Seo and Han, Jeong Mo and Hwang, Daniel Duck-Jin},
title = {Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy},
journal = {Journal of Medical Internet Research},
year = {2023},
volume = {25},
pages = {e48142},
doi = {10.2196/48142}
}
EUVIMED