CT-Net: an interpretable CNN-Transformer fusion network for fNIRS classification
Medical & Biological Engineering & Computing · 2024-10 · 62 (10) · 3233-3247
DOI: 10.1007/s11517-024-03138-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift Medical & Biological Engineering & Computing, online erschienen am 30.05.2024. Verfasst von Lingxiang Liao und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China. Hauptthemen laut MEDLINE: Spectroscopy, Near-Infrared, Neural Networks, Computer. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: Sichuan Science and Technology Program, Scientific Research Foundation for Returned Scholars of Ministry of Education.
Abstract (Originalsprache)
Functional near-infrared spectroscopy (fNIRS), an optical neuroimaging technique, has been widely used in the field of brain activity recognition and brain-computer interface. Existing works have proposed deep learning-based algorithms for the fNIRS classification problem. In this paper, a novel approach based on convolutional neural network and Transformer, named CT-Net, is established to guide the deep modeling for the classification of mental arithmetic (MA) tasks. We explore the effect of data representations, and design a temporal-level combination of two raw chromophore signals to improve the data utilization and enrich the feature learning of the model. We evaluate our model on two open-access datasets and achieve the classification accuracy of 98.05% and 77.61%, respectively. Moreover, we explain our model by the gradient-weighted class activation mapping, which presents a high consistent between the contributing value of features learned by the model and the mapping of brain activity in the MA task. The results suggest the feasibility and interpretability of CT-Net for decoding MA tasks.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China.
- School of Life Sciences and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, China.
- School of Computer Science, Chengdu University of Information Technology, Chengdu, 610225, China. wangmanqing@cuit.edu.cn.
- School of Life Sciences and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, China. wangmanqing@cuit.edu.cn.
Förderung
- Sichuan Science and Technology Program
- Scientific Research Foundation for Returned Scholars of Ministry of Education
Zitieren
APA
Liao, L., Lu, J., Wang, L., Zhang, Y., Gao, D., & Wang, M. (2024). CT-Net: an interpretable CNN-Transformer fusion network for fNIRS classification. Medical & Biological Engineering & Computing, 62(10), 3233-3247. https://doi.org/10.1007/s11517-024-03138-4
Vancouver
Liao L, Lu J, Wang L, Zhang Y, Gao D, Wang M. CT-Net: an interpretable CNN-Transformer fusion network for fNIRS classification. Medical & Biological Engineering & Computing. 2024;62(10):3233-3247. doi:10.1007/s11517-024-03138-4
BibTeX
@article{Liao2024,
author = {Liao, Lingxiang and Lu, Jingqing and Wang, Lutao and Zhang, Yongqing and Gao, Dongrui and Wang, Manqing},
title = {CT-Net: an interpretable CNN-Transformer fusion network for fNIRS classification},
journal = {Medical & Biological Engineering & Computing},
year = {2024},
volume = {62},
number = {10},
pages = {3233--3247},
doi = {10.1007/s11517-024-03138-4}
}
EUVIMED