EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ModFus-PD: synergizing cross-modal attention and contrastive learning for enhanced multimodal diagnosis of Parkinson’s disease

Xiangze Teng, Xiang Li, Benzheng Wei

Frontiers in Computational Neuroscience · 16.07.2025 · 19

DOI: 10.3389/fncom.2025.1604399 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Computational Neuroscience, online erschienen am 16.07.2025. Verfasst von Xiangze Teng und 2 weiteren Autor:innen. Beteiligte Einrichtung: Center for Medical Artificial Intelligence, Shandong University of Traditional Chinese Medicine, Qingdao, China. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Parkinson’s disease (PD) is a complex neurodegenerative disorder characterized by a high rate of misdiagnosis, underscoring the critical importance of early and accurate diagnosis. Although existing computer-aided diagnostic systems integrate clinical assessment scales with neuroimaging data, they typically rely on superficial feature concatenation, which fails to capture the deep inter-modal dependencies essential for effective multimodal fusion. To address this limitation, we propose ModFus-PD, Contrastive learning effectively aligns heterogeneous modalities such as imaging and clinical text, while the cross-modal attention mechanism further exploits semantic interactions between them to enhance feature fusion. The framework comprises three key components: (1) a contrastive learning-based feature alignment module that projects MRI data and clinical text prompts into a unified embedding space via pretrained image and text encoders; (2) a bidirectional cross-modal attention module in which textual semantics guide MRI feature refinement for improved sensitivity to PD-related brain regions, while MRI features simultaneously enhance the contextual understanding of clinical text; (3) a hierarchical classification module that integrates the fused representations through two fully connected layers to produce final PD classification probabilities. Experiments on the PPMI dataset demonstrate the superior performance of ModFus-PD, achieving an accuracy of 0.903, AUC of 0.892, and F1 score of 0.840, surpassing several state-of-the-art baselines. These results validate the effectiveness of our cross-modal fusion strategy, which enables interpretable and reliable diagnostic support, holding promise for future clinical translation.

Schlagwörter

Stichwörter der Autor:innen

contrastive learningcrossmodal attentionearly diagnosis of Parkinson’s diseasemultimodal fusionmultimodal representation learning

Autor:innen und Institutionen

  • Center for Medical Artificial Intelligence, Shandong University of Traditional Chinese Medicine, Qingdao, China.
  • Qingdao Academy of Chinese Medical Sciences, Shandong University of Traditional Chinese Medicine, Qingdao, China.
  • Qingdao Key Laboratory of Artificial Intelligence Technology for Chinese Medicine, Qingdao, China.

Zitieren

APA

Teng, X., Li, X., & Wei, B. (2025). ModFus-PD: synergizing cross-modal attention and contrastive learning for enhanced multimodal diagnosis of Parkinson’s disease. Frontiers in Computational Neuroscience, 19. https://doi.org/10.3389/fncom.2025.1604399

Vancouver

Teng X, Li X, Wei B. ModFus-PD: synergizing cross-modal attention and contrastive learning for enhanced multimodal diagnosis of Parkinson’s disease. Frontiers in Computational Neuroscience. 2025;19. doi:10.3389/fncom.2025.1604399

BibTeX
@article{Teng2025,
  author = {Teng, Xiangze and Li, Xiang and Wei, Benzheng},
  title = {ModFus-PD: synergizing cross-modal attention and contrastive learning for enhanced multimodal diagnosis of Parkinson’s disease},
  journal = {Frontiers in Computational Neuroscience},
  year = {2025},
  volume = {19},
  doi = {10.3389/fncom.2025.1604399}
}
Kostenlos starten →