EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network
Brain Sciences · 16.08.2024 · 14 (8) · 820
DOI: 10.3390/brainsci14080820 ↗Kurz gefasst
Fachartikel in der Zeitschrift Brain Sciences, online erschienen am 16.08.2024. Verfasst von Guijun Chen und 2 weiteren Autor:innen. Beteiligte Einrichtung: College of Electronic Information and Optical Engineering, Taiyuan University of Technology, Taiyuan 030024, China. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Program of Shanxi Province, China, Research Project Supported by Shanxi Scholarship Council of China.
Abstract (Originalsprache)
Electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) can objectively reflect a person’s emotional state and have been widely studied in emotion recognition. However, the effective feature fusion and discriminative feature learning from EEG–fNIRS data is challenging. In order to improve the accuracy of emotion recognition, a graph convolution and capsule attention network model (GCN-CA-CapsNet) is proposed. Firstly, EEG–fNIRS signals are collected from 50 subjects induced by emotional video clips. And then, the features of the EEG and fNIRS are extracted; the EEG–fNIRS features are fused to generate higher-quality primary capsules by graph convolution with the Pearson correlation adjacency matrix. Finally, the capsule attention module is introduced to assign different weights to the primary capsules, and higher-quality primary capsules are selected to generate better classification capsules in the dynamic routing mechanism. We validate the efficacy of the proposed method on our emotional EEG–fNIRS dataset with an ablation study. Extensive experiments demonstrate that the proposed GCN-CA-CapsNet method achieves a more satisfactory performance against the state-of-the-art methods, and the average accuracy can increase by 3–11%.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Electronic Information and Optical Engineering, Taiyuan University of Technology, Taiyuan 030024, China.
ORCID-Profile: Guijun Chen
Förderung
- National Natural Science Foundation of China
- Fundamental Research Program of Shanxi Province, China
- Research Project Supported by Shanxi Scholarship Council of China
- Research Project of Shanxi Scholarship Council, China
Zitieren
APA
Chen, G., Liu, Y., & Zhang, X. (2024). EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network. Brain Sciences, 14(8), 820. https://doi.org/10.3390/brainsci14080820
Vancouver
Chen G, Liu Y, Zhang X. EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network. Brain Sciences. 2024;14(8):820. doi:10.3390/brainsci14080820
BibTeX
@article{Chen2024,
author = {Chen, Guijun and Liu, Yue and Zhang, Xueying},
title = {EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network},
journal = {Brain Sciences},
year = {2024},
volume = {14},
number = {8},
pages = {820},
doi = {10.3390/brainsci14080820}
}
EUVIMED