ModFus-PD: synergizing cross-modal attention and contrastive learning for enhanced multimodal diagnosis of Parkinson’s disease
Frontiers in Computational Neuroscience · 16.07.2025 · 19
DOI: 10.3389/fncom.2025.1604399 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Computational Neuroscience, online erschienen am 16.07.2025. Verfasst von Xiangze Teng und 2 weiteren Autor:innen. Beteiligte Einrichtung: Center for Medical Artificial Intelligence, Shandong University of Traditional Chinese Medicine, Qingdao, China. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Parkinson’s disease (PD) is a complex neurodegenerative disorder characterized by a high rate of misdiagnosis, underscoring the critical importance of early and accurate diagnosis. Although existing computer-aided diagnostic systems integrate clinical assessment scales with neuroimaging data, they typically rely on superficial feature concatenation, which fails to capture the deep inter-modal dependencies essential for effective multimodal fusion. To address this limitation, we propose ModFus-PD, Contrastive learning effectively aligns heterogeneous modalities such as imaging and clinical text, while the cross-modal attention mechanism further exploits semantic interactions between them to enhance feature fusion. The framework comprises three key components: (1) a contrastive learning-based feature alignment module that projects MRI data and clinical text prompts into a unified embedding space via pretrained image and text encoders; (2) a bidirectional cross-modal attention module in which textual semantics guide MRI feature refinement for improved sensitivity to PD-related brain regions, while MRI features simultaneously enhance the contextual understanding of clinical text; (3) a hierarchical classification module that integrates the fused representations through two fully connected layers to produce final PD classification probabilities. Experiments on the PPMI dataset demonstrate the superior performance of ModFus-PD, achieving an accuracy of 0.903, AUC of 0.892, and F1 score of 0.840, surpassing several state-of-the-art baselines. These results validate the effectiveness of our cross-modal fusion strategy, which enables interpretable and reliable diagnostic support, holding promise for future clinical translation.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Center for Medical Artificial Intelligence, Shandong University of Traditional Chinese Medicine, Qingdao, China.
- Qingdao Academy of Chinese Medical Sciences, Shandong University of Traditional Chinese Medicine, Qingdao, China.
- Qingdao Key Laboratory of Artificial Intelligence Technology for Chinese Medicine, Qingdao, China.
Zitieren
APA
Teng, X., Li, X., & Wei, B. (2025). ModFus-PD: synergizing cross-modal attention and contrastive learning for enhanced multimodal diagnosis of Parkinson’s disease. Frontiers in Computational Neuroscience, 19. https://doi.org/10.3389/fncom.2025.1604399
Vancouver
Teng X, Li X, Wei B. ModFus-PD: synergizing cross-modal attention and contrastive learning for enhanced multimodal diagnosis of Parkinson’s disease. Frontiers in Computational Neuroscience. 2025;19. doi:10.3389/fncom.2025.1604399
BibTeX
@article{Teng2025,
author = {Teng, Xiangze and Li, Xiang and Wei, Benzheng},
title = {ModFus-PD: synergizing cross-modal attention and contrastive learning for enhanced multimodal diagnosis of Parkinson’s disease},
journal = {Frontiers in Computational Neuroscience},
year = {2025},
volume = {19},
doi = {10.3389/fncom.2025.1604399}
}
EUVIMED