EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Imaging‐genomic spatial‐modality attentive fusion for studying neuropsychiatric disorders

Md Abdur Rahaman iD, Yash Garg, Armin Iraji, Zening Fu, Peter Kochunov, L Elliot Hong, Theo G M Van Erp, Adrian Preda, Jiayu Chen, Vince Calhoun

Human Brain Mapping · 2024

DOI: 10.1002/hbm.26799 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Human Brain Mapping, 2024. Verfasst von Md Abdur Rahaman und 9 weiteren Autor:innen. Beteiligte Einrichtung: Georgia Institute of Technology, Atlanta, Georgia, USA. Hauptthemen laut MEDLINE: Schizophrenia. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 92 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIMH NIH HHS, NINDS NIH HHS, NIBIB NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal learning has emerged as a powerful technique that leverages diverse data sources to enhance learning and decision‐making processes. Adapting this approach to analyzing data collected from different biological domains is intuitive, especially for studying neuropsychiatric disorders. A complex neuropsychiatric disorder like schizophrenia (SZ) can affect multiple aspects of the brain and biologies. These biological sources each present distinct yet correlated expressions of subjects' underlying physiological processes. Joint learning from these data sources can improve our understanding of the disorder. However, combining these biological sources is challenging for several reasons: (i) observations are domain specific, leading to data being represented in dissimilar subspaces, and (ii) fused data are often noisy and high‐dimensional, making it challenging to identify relevant information. To address these challenges, we propose a multimodal artificial intelligence model with a novel fusion module inspired by a bottleneck attention module. We use deep neural networks to learn latent space representations of the input streams. Next, we introduce a two‐dimensional (spatio‐modality) attention module to regulate the intermediate fusion for SZ classification. We implement spatial attention via a dilated convolutional neural network that creates large receptive fields for extracting significant contextual patterns. The resulting joint learning framework maximizes complementarity allowing us to explore the correspondence among the modalities. We test our model on a multimodal imaging‐genetic dataset and achieve an SZ prediction accuracy of 94.10% ( p < .0001), outperforming state‐of‐the‐art unimodal and multimodal models for the task. Moreover, the model provides inherent interpretability that helps identify concepts significant for the neural network's decision and explains the underlying physiopathology of the disorder. Results also show that functional connectivity among subcortical, sensorimotor, and cognitive control domains plays an important role in characterizing SZ. Analysis of the spatio‐modality attention scores suggests that structural components like the supplementary motor area, caudate, and insula play a significant role in SZ. Biclustering the attention scores discover a multimodal cluster that includes genes CSMD1, ATK3, MOB4, and HSPE1, all of which have been identified as relevant to SZ. In summary, feature attribution appears to be especially useful for probing the transient and confined but decisive patterns of complex disorders, and it shows promise for extensive applicability in future studies.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SchizophreniaHumansMagnetic Resonance ImagingDeep LearningAdultMultimodal ImagingNeuroimagingAttentionBrainNeural Networks, ComputerMachine Learning

Stichwörter der Autor:innen

bottleneck attention module (BAM)functional network connectivity (FNC)imaging‐geneticsmultimodal fusionresting‐state functional and structural MRIschizophrenia classificationsingle‐nucleotide polymorphism (SNP)

Autor:innen und Institutionen

  • Georgia Institute of Technology, Atlanta, Georgia, USA.
  • Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Atlanta, Georgia, USA.
  • Nokia Bell Labs, Murray Hill, New Jersey, USA.
  • Department of Computer Science, Georgia State University, Atlanta, Georgia, USA.
  • University of Maryland Center for Brain Imaging Research, College Park, Maryland, USA.
  • Clinical Translational Neuroscience Laboratory, Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, California, USA.

ORCID-Profile: Md Abdur Rahaman

Förderung

  • NIMH NIH HHS
  • NINDS NIH HHS
  • NIBIB NIH HHS
  • National Science Foundation
  • NIH HHS
  • National Institutes of Health

Zitieren

APA

Rahaman, M. A., Garg, Y., Iraji, A., Fu, Z., Kochunov, P., Hong, L. E., Van Erp, T. G. M., Preda, A., Chen, J., & Calhoun, V. (2024). Imaging‐genomic spatial‐modality attentive fusion for studying neuropsychiatric disorders. Human Brain Mapping. https://doi.org/10.1002/hbm.26799

Vancouver

Rahaman MA, Garg Y, Iraji A, Fu Z, Kochunov P, Hong LE, et al. Imaging‐genomic spatial‐modality attentive fusion for studying neuropsychiatric disorders. Human Brain Mapping. 2024. doi:10.1002/hbm.26799

BibTeX
@article{Rahaman2024,
  author = {Rahaman, Md Abdur and Garg, Yash and Iraji, Armin and Fu, Zening and Kochunov, Peter and Hong, L Elliot and Van Erp, Theo G M and Preda, Adrian and Chen, Jiayu and Calhoun, Vince},
  title = {Imaging‐genomic spatial‐modality attentive fusion for studying neuropsychiatric disorders},
  journal = {Human Brain Mapping},
  year = {2024},
  doi = {10.1002/hbm.26799}
}
Kostenlos starten →