Explainable fMRI ‐based brain decoding via spatial temporal‐pyramid graph convolutional network
Human Brain Mapping · 2023-05 · 44 (7) · 2921-2935
DOI: 10.1002/hbm.26255 ↗Kurz gefasst
Fachartikel in der Zeitschrift Human Brain Mapping, online erschienen am 28.02.2023. Verfasst von Ziyuan Ye und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen, Guangdong, China. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Connectome. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China.
Abstract (Originalsprache)
Brain decoding, aiming to identify the brain states using neural activity, is important for cognitive neuroscience and neural engineering. However, existing machine learning methods for fMRI‐based brain decoding either suffer from low classification performance or poor explainability. Here, we address this issue by proposing a biologically inspired architecture, Spatial Temporal‐pyramid Graph Convolutional Network (STpGCN), to capture the spatial–temporal graph representation of functional brain activities. By designing multi‐scale spatial–temporal pathways and bottom‐up pathways that mimic the information process and temporal integration in the brain, STpGCN is capable of explicitly utilizing the multi‐scale temporal dependency of brain activities via graph, thereby achieving high brain decoding performance. Additionally, we propose a sensitivity analysis method called BrainNetX to better explain the decoding results by automatically annotating task‐related brain regions from the brain‐network standpoint. We conduct extensive experiments on fMRI data under 23 cognitive tasks from Human Connectome Project (HCP) S1200. The results show that STpGCN significantly improves brain‐decoding performance compared to competing baseline models; BrainNetX successfully annotates task‐relevant brain regions. Post hoc analysis based on these regions further validates that the hierarchical structure in STpGCN significantly contributes to the explainability, robustness and generalization of the model. Our methods not only provide insights into information representation in the brain under multiple cognitive tasks but also indicate a bright future for fMRI‐based brain decoding.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen, Guangdong, China.
ORCID-Profile: Ziyuan Ye, Quanying Liu
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
Zitieren
APA
Ye, Z., Qu, Y., Liang, Z., Wang, M., & Liu, Q. (2023). Explainable fMRI ‐based brain decoding via spatial temporal‐pyramid graph convolutional network. Human Brain Mapping, 44(7), 2921-2935. https://doi.org/10.1002/hbm.26255
Vancouver
Ye Z, Qu Y, Liang Z, Wang M, Liu Q. Explainable fMRI ‐based brain decoding via spatial temporal‐pyramid graph convolutional network. Human Brain Mapping. 2023;44(7):2921-2935. doi:10.1002/hbm.26255
BibTeX
@article{Ye2023,
author = {Ye, Ziyuan and Qu, Youzhi and Liang, Zhichao and Wang, Mo and Liu, Quanying},
title = {Explainable fMRI ‐based brain decoding via spatial temporal‐pyramid graph convolutional network},
journal = {Human Brain Mapping},
year = {2023},
volume = {44},
number = {7},
pages = {2921--2935},
doi = {10.1002/hbm.26255}
}
EUVIMED