EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network

Guijun Chen iD, Yue Liu, Xueying Zhang

Brain Sciences · 16.08.2024 · 14 (8) · 820

DOI: 10.3390/brainsci14080820 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Brain Sciences, online erschienen am 16.08.2024. Verfasst von Guijun Chen und 2 weiteren Autor:innen. Beteiligte Einrichtung: College of Electronic Information and Optical Engineering, Taiyuan University of Technology, Taiyuan 030024, China. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Program of Shanxi Province, China, Research Project Supported by Shanxi Scholarship Council of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) can objectively reflect a person’s emotional state and have been widely studied in emotion recognition. However, the effective feature fusion and discriminative feature learning from EEG–fNIRS data is challenging. In order to improve the accuracy of emotion recognition, a graph convolution and capsule attention network model (GCN-CA-CapsNet) is proposed. Firstly, EEG–fNIRS signals are collected from 50 subjects induced by emotional video clips. And then, the features of the EEG and fNIRS are extracted; the EEG–fNIRS features are fused to generate higher-quality primary capsules by graph convolution with the Pearson correlation adjacency matrix. Finally, the capsule attention module is introduced to assign different weights to the primary capsules, and higher-quality primary capsules are selected to generate better classification capsules in the dynamic routing mechanism. We validate the efficacy of the proposed method on our emotional EEG–fNIRS dataset with an ablation study. Extensive experiments demonstrate that the proposed GCN-CA-CapsNet method achieves a more satisfactory performance against the state-of-the-art methods, and the average accuracy can increase by 3–11%.

Schlagwörter

Stichwörter der Autor:innen

capsule attention networkelectroencephalogram (EEG)emotion recognitionfunctional near-infrared spectroscopy (fNIRS)graph convolution network

Autor:innen und Institutionen

  • College of Electronic Information and Optical Engineering, Taiyuan University of Technology, Taiyuan 030024, China.

ORCID-Profile: Guijun Chen

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Program of Shanxi Province, China
  • Research Project Supported by Shanxi Scholarship Council of China
  • Research Project of Shanxi Scholarship Council, China

Zitieren

APA

Chen, G., Liu, Y., & Zhang, X. (2024). EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network. Brain Sciences, 14(8), 820. https://doi.org/10.3390/brainsci14080820

Vancouver

Chen G, Liu Y, Zhang X. EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network. Brain Sciences. 2024;14(8):820. doi:10.3390/brainsci14080820

BibTeX
@article{Chen2024,
  author = {Chen, Guijun and Liu, Yue and Zhang, Xueying},
  title = {EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network},
  journal = {Brain Sciences},
  year = {2024},
  volume = {14},
  number = {8},
  pages = {820},
  doi = {10.3390/brainsci14080820}
}
Kostenlos starten →