3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer’s Disease Diagnosis
IEEE Transactions on Medical Imaging · 2024-09 · 43 (9) · 3161-3175
DOI: 10.1109/tmi.2024.3386937 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2024-09. Verfasst von Zifeng Qiu und 8 weiteren Autor:innen. Hauptthemen laut MEDLINE: Alzheimer Disease, Multimodal Imaging. Die Arbeit wurde bisher 90-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Natural Science Foundation of Guangdong Province, Shenzhen Science and Technology Program.
Themen: Demenz
Abstract (Originalsprache)
Multimodal neuroimaging provides complementary information critical for accurate early diagnosis of Alzheimer's disease (AD). However, the inherent variability between multimodal neuroimages hinders the effective fusion of multimodal features. Moreover, achieving reliable and interpretable diagnoses in the field of multimodal fusion remains challenging. To address them, we propose a novel multimodal diagnosis network based on multi-fusion and disease-induced learning (MDL-Net) to enhance early AD diagnosis by efficiently fusing multimodal data. Specifically, MDL-Net proposes a multi-fusion joint learning (MJL) module, which effectively fuses multimodal features and enhances the feature representation from global, local, and latent learning perspectives. MJL consists of three modules, global-aware learning (GAL), local-aware learning (LAL), and outer latent-space learning (LSL) modules. GAL via a self-adaptive Transformer (SAT) learns the global relationships among the modalities. LAL constructs local-aware convolution to learn the local associations. LSL module introduces latent information through outer product operation to further enhance feature representation. MDL-Net integrates the disease-induced region-aware learning (DRL) module via gradient weight to enhance interpretability, which iteratively learns weight matrices to identify AD-related brain regions. We conduct the extensive experiments on public datasets and the results confirm the superiority of our proposed method. Our code will be available at: https://github.com/qzf0320/MDL-Net.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- National Natural Science Foundation of Guangdong Province
- Shenzhen Science and Technology Program
- Innovation and Technology Fund through Guangdong-Hong Kong Technology Cooperation Funding Scheme
- National Taipei University of Technology-Shenzhen University (NTUT-SZU) Joint Research Program
Zitieren
APA
Qiu, Z., Yang, P., Xiao, C., Wang, S., Xiao, X., Qin, J., Liu, C. M., Wang, T., & Lei, B. (2024). 3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer’s Disease Diagnosis. IEEE Transactions on Medical Imaging, 43(9), 3161-3175. https://doi.org/10.1109/tmi.2024.3386937
Vancouver
Qiu Z, Yang P, Xiao C, Wang S, Xiao X, Qin J, et al. 3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer’s Disease Diagnosis. IEEE Transactions on Medical Imaging. 2024;43(9):3161-3175. doi:10.1109/tmi.2024.3386937
BibTeX
@article{Qiu2024,
author = {Qiu, Zifeng and Yang, Peng and Xiao, Chunlun and Wang, Shuqiang and Xiao, Xiaohua and Qin, Jing and Liu, Chuan-Ming and Wang, Tianfu and Lei, Baiying},
title = {3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer’s Disease Diagnosis},
journal = {IEEE Transactions on Medical Imaging},
year = {2024},
volume = {43},
number = {9},
pages = {3161--3175},
doi = {10.1109/tmi.2024.3386937}
}
EUVIMED