EUVIMEDEUVIMED entdecken
Crossref

M2Net: Multimodal Multitask Mutual Learning for Anti-VEGF Efficacy Prediction

Yang Wen, Ying Zeng, Lei Bi, Xinyu Zhao, Wuzhen Shi, Huazhu Fu, Bin Sheng

IEEE Transactions on Medical Imaging · 2026

DOI: 10.1109/tmi.2026.3684331 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2026. Verfasst von Yang Wen und 6 weiteren Autor:innen. Hauptthemen laut MEDLINE: Vascular Endothelial Growth Factor A, Macular Degeneration, Angiogenesis Inhibitors, Image Interpretation, Computer-Assisted. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province, Shenzhen Science and Technology Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Age-related macular degeneration with abnormal blood vessel growth (neovascular AMD) is the leading cause of vision loss in elderly populations. While anti-VEGF injections are the standard treatment, they present financial burdens for patients and vary in effectiveness. Predicting treatment efficacy is therefore crucial for patient care. Current prediction methods fail to fully integrate information from different imaging techniques, typically focusing on either forecasting vision improvements or generating post-treatment images-but not both simultaneously. This approach overlooks the important relationship between these tasks. We present M2Net, a novel joint generation and classification network based on Multimodal Multitask Mutual learning, to simultaneously predict changes in visual acuity and generate post-treatment retinal images. M2Net employs a dual-branch structure that processes both fundus photographs and Optical Coherence Tomography (OCT) scans to improve prediction accuracy. Our framework includes two key innovations: the Multimodal Collaborative Treatment Efficacy Prediction module, which interacts the features between the two modalities and provides initial visual acuity change classification to guide the generation of post-treatment images; and the Pre-Post Treatment Image Joint Analysis module, which identifies both common and changing features between pre-treatment and post-treatment images to enhance prediction accuracy. To validate our approach, we created the dataset (MMPD) containing paired multimodal retinal images with corresponding visual acuity measurements. Experiments on the dataset demonstrate that M2Net achieves superior performance compared to existing methods, with a classification accuracy of 96.03%, an SSIM of 0.6377 on the OCT modality, and an SSIM of 0.8347 on the fundus modality. Our code will be available at https://github.com/zengying123/M2Net.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Vascular Endothelial Growth Factor AMacular DegenerationAngiogenesis InhibitorsImage Interpretation, Computer-AssistedHumansTomography, Optical CoherenceMultimodal ImagingVisual AcuityRetinaPredictive Learning ModelsNeural Networks, ComputerTreatment Outcome

Substanzen

Vascular Endothelial Growth Factor AAngiogenesis Inhibitors

Förderung

  • National Natural Science Foundation of China
  • Basic and Applied Basic Research Foundation of Guangdong Province
  • Shenzhen Science and Technology Program
  • Guangdong Provincial Key Laboratory

Zitieren

APA

Wen, Y., Zeng, Y., Bi, L., Zhao, X., Shi, W., Fu, H., & Sheng, B. (2026). M2Net: Multimodal Multitask Mutual Learning for Anti-VEGF Efficacy Prediction. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2026.3684331

Vancouver

Wen Y, Zeng Y, Bi L, Zhao X, Shi W, Fu H, et al. M2Net: Multimodal Multitask Mutual Learning for Anti-VEGF Efficacy Prediction. IEEE Transactions on Medical Imaging. 2026. doi:10.1109/tmi.2026.3684331

BibTeX
@article{Wen2026,
  author = {Wen, Yang and Zeng, Ying and Bi, Lei and Zhao, Xinyu and Shi, Wuzhen and Fu, Huazhu and Sheng, Bin},
  title = {M2Net: Multimodal Multitask Mutual Learning for Anti-VEGF Efficacy Prediction},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2026},
  doi = {10.1109/tmi.2026.3684331}
}
Kostenlos starten →