EUVIMEDDescoperă EUVIMED
Open access

Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy

Jeewoo Yoon iD, Jinyoung Han iD, Junseo Ko iD, Seong Choi iD, Ji In Park iD, Joon Seo Hwang iD, Jeong Mo Han iD, Daniel Duck-Jin Hwang iD

Journal of Medical Internet Research · 2023-11-29 · 25 · e48142

DOI: 10.2196/48142 ↗

At a glance

Journal article in Journal of Medical Internet Research, published online on 2023-11-29. Written by Jeewoo Yoon and 7 co-authors. Institution: Department of Applied Artificial Intelligence, Sungkyunkwan University, Seoul, Republic of Korea. Major MEDLINE topics: Central Serous Chorioretinopathy, Diagnosis, Computer-Assisted. Cited 15 times so far (Crossref); 34 references. The full text is freely available in PubMed Central.

RezumatSubjectsDate bibliograficeCiteRelated studies

Abstract (original language)

Background

Although previous research has made substantial progress in developing high-performance artificial intelligence (AI)–based computer-aided diagnosis (AI-CAD) systems in various medical domains, little attention has been paid to developing and evaluating AI-CAD system in ophthalmology, particularly for diagnosing retinal diseases using optical coherence tomography (OCT) images.

Objective

This diagnostic study aimed to determine the usefulness of a proposed AI-CAD system in assisting ophthalmologists with the diagnosis of central serous chorioretinopathy (CSC), which is known to be difficult to diagnose, using OCT images.

Methods

For the training and evaluation of the proposed deep learning model, 1693 OCT images were collected and annotated. The data set included 929 and 764 cases of acute and chronic CSC, respectively. In total, 66 ophthalmologists (2 groups: 36 retina and 30 nonretina specialists) participated in the observer performance test. To evaluate the deep learning algorithm used in the proposed AI-CAD system, the training, validation, and test sets were split in an 8:1:1 ratio. Further, 100 randomly sampled OCT images from the test set were used for the observer performance test, and the participants were instructed to select a CSC subtype for each of these images. Each image was provided under different conditions: (1) without AI assistance, (2) with AI assistance with a probability score, and (3) with AI assistance with a probability score and visual evidence heatmap. The sensitivity, specificity, and area under the receiver operating characteristic curve were used to measure the diagnostic performance of the model and ophthalmologists.

Results

The proposed system achieved a high detection performance (99% of the area under the curve) for CSC, outperforming the 66 ophthalmologists who participated in the observer performance test. In both groups, ophthalmologists with the support of AI assistance with a probability score and visual evidence heatmap achieved the highest mean diagnostic performance compared with that of those subjected to other conditions (without AI assistance or with AI assistance with a probability score). Nonretina specialists achieved expert-level diagnostic performance with the support of the proposed AI-CAD system.

Conclusions

Our proposed AI-CAD system improved the diagnosis of CSC by ophthalmologists, which may support decision-making regarding retinal disease detection and alleviate the workload of ophthalmologists.

Subjects

MeSH terms (MEDLINE)

Central Serous ChorioretinopathyDiagnosis, Computer-AssistedHumansAlgorithmsArtificial IntelligenceComputersDeep Learning

Author keywords

artificial intelligencecentral serous chorioretinopathycomputer aided diagnosiscomputer visiondeep learningdiagnostic studyimaging informaticsophthalmologyretinal disease

Authors and institutions

  • Department of Applied Artificial Intelligence, Sungkyunkwan University, Seoul, Republic of Korea.
  • Raondata, Seoul, Republic of Korea.
  • Department of Human-Artificial Intelligence Interaction, Sungkyunkwan University, Seoul, Republic of Korea.
  • Department of Medicine, Kangwon National University School of Medicine, Kangwon National University Hospital, Chuncheon, Republic of Korea.
  • Seoul Plus Eye Clinic, Seoul, Republic of Korea.
  • Seoul Bombit Eye Clinic, Sejong, Republic of Korea.

ORCID profiles: Jeewoo Yoon, Jinyoung Han, Junseo Ko, Seong Choi, Ji In Park, Joon Seo Hwang, Jeong Mo Han, Daniel Duck-Jin Hwang

Cite

APA

Yoon, J., Han, J., Ko, J., Choi, S., Park, J. I., Hwang, J. S., Han, J. M., & Hwang, D. D. (2023). Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy. Journal of Medical Internet Research, 25, e48142. https://doi.org/10.2196/48142

Vancouver

Yoon J, Han J, Ko J, Choi S, Park JI, Hwang JS, et al. Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy. Journal of Medical Internet Research. 2023;25:e48142. doi:10.2196/48142

BibTeX
@article{Yoon2023,
  author = {Yoon, Jeewoo and Han, Jinyoung and Ko, Junseo and Choi, Seong and Park, Ji In and Hwang, Joon Seo and Han, Jeong Mo and Hwang, Daniel Duck-Jin},
  title = {Developing and Evaluating an AI-Based Computer-Aided Diagnosis System for Retinal Disease: Diagnostic Study for Central Serous Chorioretinopathy},
  journal = {Journal of Medical Internet Research},
  year = {2023},
  volume = {25},
  pages = {e48142},
  doi = {10.2196/48142}
}
Start for free →