Cross-modal attention network for retinal disease classification based on multi-modal images
Biomedical Optics Express · 01.06.2024 · 15 (6) · 3699
DOI: 10.1364/boe.516764 ↗Kurz gefasst
Fachartikel in der Zeitschrift Biomedical Optics Express, online erschienen am 14.05.2024. Verfasst von Zirong Liu und 9 weiteren Autor:innen. Beteiligte Einrichtung: School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou 325027, China. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Natural Science Foundation of China, Shenzhen Stable Support Plan Program.
Abstract (Originalsprache)
Multi-modal eye disease screening improves diagnostic accuracy by providing lesion information from different sources. However, existing multi-modal automatic diagnosis methods tend to focus on the specificity of modalities and ignore the spatial correlation of images. This paper proposes a novel cross-modal retinal disease diagnosis network (CRD-Net) that digs out the relevant features from modal images aided for multiple retinal disease diagnosis. Specifically, our model introduces a cross-modal attention (CMA) module to query and adaptively pay attention to the relevant features of the lesion in the different modal images. In addition, we also propose multiple loss functions to fuse features with modality correlation and train a multi-modal retinal image classification network to achieve a more accurate diagnosis. Experimental evaluation on three publicly available datasets shows that our CRD-Net outperforms existing single-modal and multi-modal methods, demonstrating its superior performance.
Autor:innen und Institutionen
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou 325027, China.
- Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen 518055, China.
- huy3@sustech.edu.cn.
Förderung
- National Natural Science Foundation of China
- Shenzhen Stable Support Plan Program
Zitieren
APA
Liu, Z., Hu, Y., Qiu, Z., Niu, Y., Zhou, D., Li, X., Shen, J., Jiang, H., Li, H., & Liu, J. (2024). Cross-modal attention network for retinal disease classification based on multi-modal images. Biomedical Optics Express, 15(6), 3699. https://doi.org/10.1364/boe.516764
Vancouver
Liu Z, Hu Y, Qiu Z, Niu Y, Zhou D, Li X, et al. Cross-modal attention network for retinal disease classification based on multi-modal images. Biomedical Optics Express. 2024;15(6):3699. doi:10.1364/boe.516764
BibTeX
@article{Liu2024,
author = {Liu, Zirong and Hu, Yan and Qiu, Zhongxi and Niu, Yanyan and Zhou, Dan and Li, Xiaoling and Shen, Junyong and Jiang, Hongyang and Li, Heng and Liu, Jiang},
title = {Cross-modal attention network for retinal disease classification based on multi-modal images},
journal = {Biomedical Optics Express},
year = {2024},
volume = {15},
number = {6},
pages = {3699},
doi = {10.1364/boe.516764}
}
EUVIMED