EUVIMEDEUVIMED entdecken
Crossref

MultiEYE: Dataset and Benchmark for OCT-Enhanced Retinal Disease Recognition From Fundus Images

Lehan Wang, Chongchong Qi, Chubin Ou, Lin An, Mei Jin, Xiangbin Kong, Xiaomeng Li

IEEE Transactions on Medical Imaging · 2025-04 · 44 (4) · 1711-1722

DOI: 10.1109/tmi.2024.3518067 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2025-04. Verfasst von Lehan Wang und 6 weiteren Autor:innen. Hauptthemen laut MEDLINE: Tomography, Optical Coherence, Fundus Oculi, Retinal Diseases, Image Interpretation, Computer-Assisted. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Foshan Hong Kong University of Science and Technology (HKUST) Projects, Project of Hetao Shenzhen Hong Kong Science and Technology Innovation Cooperation Zone.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing multi-modal learning methods on fundus and OCT images mostly require both modalities to be available and strictly paired for training and testing, which appears less practical in clinical scenarios. To expand the scope of clinical applications, we formulate a novel setting, "OCT-enhanced disease recognition from fundus images", that allows for the use of unpaired multi-modal data during the training phase, and relies on the widespread fundus photographs for testing. To benchmark this setting, we present the first large multi-modal multi-class dataset for eye disease diagnosis, MultiEYE, and propose an OCT-assisted Conceptual Distillation Approach (OCT-CoDA), which employs semantically rich concepts to extract disease-related knowledge from OCT images and leverages them into the fundus model. Specifically, we regard the image-concept relation as a link to distill useful knowledge from OCT teacher model to fundus student model, which considerably improves the diagnostic performance based on fundus images and formulates the cross-modal knowledge transfer into an explainable process. Through extensive experiments on the multi-disease classification task, our proposed OCT-CoDA demonstrates remarkable results and interpretability, showing great potential for clinical application. Our dataset and code are available at https://github.com/xmed-lab/MultiEYE.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Tomography, Optical CoherenceFundus OculiRetinal DiseasesImage Interpretation, Computer-AssistedHumansRetinaDatabases, FactualBenchmarkingAlgorithms

Förderung

  • National Natural Science Foundation of China
  • Foshan Hong Kong University of Science and Technology (HKUST) Projects
  • Project of Hetao Shenzhen Hong Kong Science and Technology Innovation Cooperation Zone
  • Guangdong Provincial Science and Technology Fund

Zitieren

APA

Wang, L., Qi, C., Ou, C., An, L., Jin, M., Kong, X., & Li, X. (2025). MultiEYE: Dataset and Benchmark for OCT-Enhanced Retinal Disease Recognition From Fundus Images. IEEE Transactions on Medical Imaging, 44(4), 1711-1722. https://doi.org/10.1109/tmi.2024.3518067

Vancouver

Wang L, Qi C, Ou C, An L, Jin M, Kong X, et al. MultiEYE: Dataset and Benchmark for OCT-Enhanced Retinal Disease Recognition From Fundus Images. IEEE Transactions on Medical Imaging. 2025;44(4):1711-1722. doi:10.1109/tmi.2024.3518067

BibTeX
@article{Wang2025,
  author = {Wang, Lehan and Qi, Chongchong and Ou, Chubin and An, Lin and Jin, Mei and Kong, Xiangbin and Li, Xiaomeng},
  title = {MultiEYE: Dataset and Benchmark for OCT-Enhanced Retinal Disease Recognition From Fundus Images},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2025},
  volume = {44},
  number = {4},
  pages = {1711--1722},
  doi = {10.1109/tmi.2024.3518067}
}
Kostenlos starten →