Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligence
Science Advances · 2026
DOI: 10.1126/sciadv.ady8751 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science Advances, 2026. Verfasst von Xiang He und 5 weiteren Autor:innen. Beteiligte Einrichtung: Brain-inspired Cognitive AI Lab, Institute of Automation, Chinese Academy of Sciences, Beijing, China. Hauptthemen laut MEDLINE: Artificial Intelligence, Brain, Learning. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 85 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Multimodal learning enhances the perceptual ability of intelligent systems by integrating information across sensory modalities. However, most artificial intelligence approaches still rely on static fusion schemes and do not account for the dynamic nature of multisensory integration observed in the brain. In biological systems, the principle of inverse effectiveness states that weaker unimodal cues contribute more strongly to multisensory integration, whereas strong cues reduce the relative benefit of fusion. Motivated by this mechanism, we investigate the relationship between multimodal outputs and modality-specific information and introduce an inverse effectiveness–driven multimodal fusion (IEMF) strategy. Integrating IEMF into neural networks yields more adaptive fusion behavior, improved accuracy, and substantial gains in computational efficiency. We validate the generality of IEMF across audiovisual perception, vision-language understanding, and trimodal sentiment analysis, demonstrating consistent improvements over state-of-the-art baselines in classification, continual learning, and question answering. The approach also transfers across architectures, including both artificial neural networks and spiking neural networks.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Brain-inspired Cognitive AI Lab, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
- Center for Long-term AI, Beijing, China.
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
- Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Chinese Academy of Sciences, Shanghai, China.
ORCID-Profile: Xiang He, Dongcheng Zhao, Yang Li, Qingqun Kong, Xin Yang, Yi Zeng
Förderung
- National Natural Science Foundation of China
Zitieren
APA
He, X., Zhao, D., Li, Y., Kong, Q., Yang, X., & Zeng, Y. (2026). Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligence. Science Advances. https://doi.org/10.1126/sciadv.ady8751
Vancouver
He X, Zhao D, Li Y, Kong Q, Yang X, Zeng Y. Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligence. Science Advances. 2026. doi:10.1126/sciadv.ady8751
BibTeX
@article{He2026,
author = {He, Xiang and Zhao, Dongcheng and Li, Yang and Kong, Qingqun and Yang, Xin and Zeng, Yi},
title = {Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligence},
journal = {Science Advances},
year = {2026},
doi = {10.1126/sciadv.ady8751}
}
EUVIMED