Mapping Multi-Modal Brain Connectome for Brain Disorder Diagnosis via Cross-Modal Mutual Learning
IEEE Transactions on Medical Imaging · 2024-01 · 43 (1) · 108-121
DOI: 10.1109/tmi.2023.3294967 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2024-01. Verfasst von Yanwu Yang und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Connectome, Brain Diseases. Die Arbeit wurde bisher 88-mal zitiert (Crossref) und nennt 77 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Innovation Team and Talents Cultivation Program of National Administration of Traditional Chinese Medicine, Basic Research Foundation of Shenzhen Science and Technology Stable Support Program.
Abstract (Originalsprache)
Recently, the study of multi-modal brain connectome has recorded a tremendous increase and facilitated the diagnosis of brain disorders. In this paradigm, functional and structural networks, e.g., functional and structural connectivity derived from fMRI and DTI, are in some manner interacted but are not necessarily linearly related. Accordingly, there remains a great challenge to leverage complementary information for brain connectome analysis. Recently, Graph Convolutional Networks (GNN) have been widely applied to the fusion of multi-modal brain connectome. However, most existing GNN methods fail to couple inter-modal relationships. In this regard, we propose a Cross-modal Graph Neural Network (Cross-GNN) that captures inter-modal dependencies through dynamic graph learning and mutual learning. Specifically, the inter-modal representations are attentively coupled into a compositional space for reasoning inter-modal dependencies. Additionally, we investigate mutual learning in explicit and implicit ways: (1) Cross-modal representations are obtained by cross-embedding explicitly based on the inter-modal correspondence matrix. (2) We propose a cross-modal distillation method to implicitly regularize latent representations with cross-modal semantic contexts. We carry out statistical analysis on the attentively learned correspondence matrices to evaluate inter-modal relationships for associating disease biomarkers. Our extensive experiments on three datasets demonstrate the superiority of our proposed method for disease diagnosis with promising prediction performance and multi-modal connectome biomarker location.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- Innovation Team and Talents Cultivation Program of National Administration of Traditional Chinese Medicine
- Basic Research Foundation of Shenzhen Science and Technology Stable Support Program
- National Key Research and Development Program of China
- Major Key Project of Peng Cheng Laboratory
Zitieren
APA
Yang, Y., Ye, C., Guo, X., Wu, T., Xiang, Y., & Ma, T. (2024). Mapping Multi-Modal Brain Connectome for Brain Disorder Diagnosis via Cross-Modal Mutual Learning. IEEE Transactions on Medical Imaging, 43(1), 108-121. https://doi.org/10.1109/tmi.2023.3294967
Vancouver
Yang Y, Ye C, Guo X, Wu T, Xiang Y, Ma T. Mapping Multi-Modal Brain Connectome for Brain Disorder Diagnosis via Cross-Modal Mutual Learning. IEEE Transactions on Medical Imaging. 2024;43(1):108-121. doi:10.1109/tmi.2023.3294967
BibTeX
@article{Yang2024,
author = {Yang, Yanwu and Ye, Chenfei and Guo, Xutao and Wu, Tao and Xiang, Yang and Ma, Ting},
title = {Mapping Multi-Modal Brain Connectome for Brain Disorder Diagnosis via Cross-Modal Mutual Learning},
journal = {IEEE Transactions on Medical Imaging},
year = {2024},
volume = {43},
number = {1},
pages = {108--121},
doi = {10.1109/tmi.2023.3294967}
}
EUVIMED