Multimodal Data Fusion in Neuroscience: Promises, challenges, and future directions [Special Issue on Accelerating Brain Discovery Through Data Science and Neurotechnology]
IEEE Signal Processing Magazine · 2025-09 · 42 (5) · 8-21
DOI: 10.1109/msp.2025.3604570 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Signal Processing Magazine, 2025-09. Verfasst von Chuang Liang und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIMH NIH HHS, National Natural Science Foundation of China, Natural Science Foundation of Jiangsu Province.
Abstract (Originalsprache)
Multimodal fusion provides significant benefits over single modality analysis by leveraging both shared and complementary information across diverse data sources. In this article, we systematically review methods for fusion of heterogonous multimodal biomedical data of varying dimensionality (including neuroimaging, biomics, clinical phenotypes and text), with a focus on neuroscience. We discuss the strengths and limitations of these strategies based on a survey of 302 research articles. Next, we examine the applications of these methods to a variety of scenarios spanning a continuum from scientific research to clinical practice. Finally, an in-depth discussion of common challenges and promising directions for future development of multimodal biomedical data fusion are provided. Overall, multimodal fusion shows substantial benefits and transformative potential in the field of neuroscience. Future research should prioritize improving model generalization, enhancing interpretability, addressing inherent data limitations, and developing unified platforms alongside multimodal foundational models to bridge the gap between fusion techniques, research, and application to various domains.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China.
- Key Laboratory of Brain-Machine Intelligence Technology, Ministry of Education, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China.
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS) Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA.
- Department of Computer Science and Electrical Engineering, University of Maryland, Baltimore County, Baltimore, Maryland, USA.
- Department of Psychiatry and Neuroscience, Yale School of Medicine, New Haven, CT, USA.
Förderung
- NIMH NIH HHS
- National Natural Science Foundation of China
- Natural Science Foundation of Jiangsu Province
- Key Research and Development Plan of Jiangsu Province
- National Institutes of Health
- National Science Foundation
Zitieren
APA
Liang, C., Silva, R. F., TulayAdali, Jiang, R., Zhang, D., Qi, S., & Calhoun, V. D. (2025). Multimodal Data Fusion in Neuroscience: Promises, challenges, and future directions [Special Issue on Accelerating Brain Discovery Through Data Science and Neurotechnology]. IEEE Signal Processing Magazine, 42(5), 8-21. https://doi.org/10.1109/msp.2025.3604570
Vancouver
Liang C, Silva RF, TulayAdali, Jiang R, Zhang D, Qi S, et al. Multimodal Data Fusion in Neuroscience: Promises, challenges, and future directions [Special Issue on Accelerating Brain Discovery Through Data Science and Neurotechnology]. IEEE Signal Processing Magazine. 2025;42(5):8-21. doi:10.1109/msp.2025.3604570
BibTeX
@article{Liang2025,
author = {Liang, Chuang and Silva, Rogers F and TulayAdali and Jiang, Rongtao and Zhang, Daoqiang and Qi, Shile and Calhoun, Vince D},
title = {Multimodal Data Fusion in Neuroscience: Promises, challenges, and future directions [Special Issue on Accelerating Brain Discovery Through Data Science and Neurotechnology]},
journal = {IEEE Signal Processing Magazine},
year = {2025},
volume = {42},
number = {5},
pages = {8--21},
doi = {10.1109/msp.2025.3604570}
}
EUVIMED