See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (6) · 5730-5738
DOI: 10.1609/aaai.v39i6.32611 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Yulong Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref).
Abstract (Originalsprache)
Deciphering visual content from fMRI sheds light on the human vision system, but data scarcity and noise limit brain decoding model performance. Traditional approaches rely on subject-specific models, which are sensitive to training sample size. In this paper, we address data scarcity by proposing shallow subject-specific adapters to map cross-subject fMRI data into unified representations. A shared deep decoding model then decodes these features into the target feature space. We use both visual and textual supervision for multi-modal brain decoding and integrate high-level perception decoding with pixel-wise reconstruction guided by high-level perceptions. Our extensive experiments reveal several interesting insights: 1) Training with cross-subject fMRI benefits both high-level and low-level decoding models; 2) Merging high-level and low-level information improves reconstruction performance at both levels; 3) Transfer learning is effective for new subjects with limited training data by training new adapters; 4) Decoders trained on visually-elicited brain activity can generalize to decode imagery-induced activity, though with reduced performance.
Zitieren
APA
Liu, Y., Ma, Y., Zhu, G., Jing, H., & Zheng, N. (2025). See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI. Proceedings of the AAAI Conference on Artificial Intelligence, 39(6), 5730-5738. https://doi.org/10.1609/aaai.v39i6.32611
Vancouver
Liu Y, Ma Y, Zhu G, Jing H, Zheng N. See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(6):5730-5738. doi:10.1609/aaai.v39i6.32611
BibTeX
@article{Liu2025,
author = {Liu, Yulong and Ma, Yongqiang and Zhu, Guibo and Jing, Haodong and Zheng, Nanning},
title = {See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {6},
pages = {5730--5738},
doi = {10.1609/aaai.v39i6.32611}
}
EUVIMED