EUVIMEDEUVIMED entdecken
Open Access

Cross-modal attention network for retinal disease classification based on multi-modal images

Zirong Liu, Yan Hu iD, Zhongxi Qiu, Yanyan Niu, Dan Zhou, Xiaoling Li, Junyong Shen, Hongyang Jiang, Heng Li iD, Jiang Liu

Biomedical Optics Express · 01.06.2024 · 15 (6) · 3699

DOI: 10.1364/boe.516764 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Biomedical Optics Express, online erschienen am 14.05.2024. Verfasst von Zirong Liu und 9 weiteren Autor:innen. Beteiligte Einrichtung: School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou 325027, China. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Natural Science Foundation of China, Shenzhen Stable Support Plan Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-modal eye disease screening improves diagnostic accuracy by providing lesion information from different sources. However, existing multi-modal automatic diagnosis methods tend to focus on the specificity of modalities and ignore the spatial correlation of images. This paper proposes a novel cross-modal retinal disease diagnosis network (CRD-Net) that digs out the relevant features from modal images aided for multiple retinal disease diagnosis. Specifically, our model introduces a cross-modal attention (CMA) module to query and adaptively pay attention to the relevant features of the lesion in the different modal images. In addition, we also propose multiple loss functions to fuse features with modality correlation and train a multi-modal retinal image classification network to achieve a more accurate diagnosis. Experimental evaluation on three publicly available datasets shows that our CRD-Net outperforms existing single-modal and multi-modal methods, demonstrating its superior performance.

Autor:innen und Institutionen

  • School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou 325027, China.
  • Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen 518055, China.
  • huy3@sustech.edu.cn.

ORCID-Profile: Yan Hu, Heng Li

Förderung

  • National Natural Science Foundation of China
  • Shenzhen Stable Support Plan Program

Zitieren

APA

Liu, Z., Hu, Y., Qiu, Z., Niu, Y., Zhou, D., Li, X., Shen, J., Jiang, H., Li, H., & Liu, J. (2024). Cross-modal attention network for retinal disease classification based on multi-modal images. Biomedical Optics Express, 15(6), 3699. https://doi.org/10.1364/boe.516764

Vancouver

Liu Z, Hu Y, Qiu Z, Niu Y, Zhou D, Li X, et al. Cross-modal attention network for retinal disease classification based on multi-modal images. Biomedical Optics Express. 2024;15(6):3699. doi:10.1364/boe.516764

BibTeX
@article{Liu2024,
  author = {Liu, Zirong and Hu, Yan and Qiu, Zhongxi and Niu, Yanyan and Zhou, Dan and Li, Xiaoling and Shen, Junyong and Jiang, Hongyang and Li, Heng and Liu, Jiang},
  title = {Cross-modal attention network for retinal disease classification based on multi-modal images},
  journal = {Biomedical Optics Express},
  year = {2024},
  volume = {15},
  number = {6},
  pages = {3699},
  doi = {10.1364/boe.516764}
}
Kostenlos starten →