EUVIMEDEUVIMED entdecken
Crossref

See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI

Yulong Liu, Yongqiang Ma, Guibo Zhu, Haodong Jing, Nanning Zheng

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (6) · 5730-5738

DOI: 10.1609/aaai.v39i6.32611 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Yulong Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deciphering visual content from fMRI sheds light on the human vision system, but data scarcity and noise limit brain decoding model performance. Traditional approaches rely on subject-specific models, which are sensitive to training sample size. In this paper, we address data scarcity by proposing shallow subject-specific adapters to map cross-subject fMRI data into unified representations. A shared deep decoding model then decodes these features into the target feature space. We use both visual and textual supervision for multi-modal brain decoding and integrate high-level perception decoding with pixel-wise reconstruction guided by high-level perceptions. Our extensive experiments reveal several interesting insights: 1) Training with cross-subject fMRI benefits both high-level and low-level decoding models; 2) Merging high-level and low-level information improves reconstruction performance at both levels; 3) Transfer learning is effective for new subjects with limited training data by training new adapters; 4) Decoders trained on visually-elicited brain activity can generalize to decode imagery-induced activity, though with reduced performance.

Zitieren

APA

Liu, Y., Ma, Y., Zhu, G., Jing, H., & Zheng, N. (2025). See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI. Proceedings of the AAAI Conference on Artificial Intelligence, 39(6), 5730-5738. https://doi.org/10.1609/aaai.v39i6.32611

Vancouver

Liu Y, Ma Y, Zhu G, Jing H, Zheng N. See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(6):5730-5738. doi:10.1609/aaai.v39i6.32611

BibTeX
@article{Liu2025,
  author = {Liu, Yulong and Ma, Yongqiang and Zhu, Guibo and Jing, Haodong and Zheng, Nanning},
  title = {See Through Their Minds: Learning Transferable Brain Decoding Models from Cross-Subject fMRI},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {6},
  pages = {5730--5738},
  doi = {10.1609/aaai.v39i6.32611}
}
Kostenlos starten →