EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion

Ni Yan iD, Guijun Chen iD, Xueying Zhang

Biosensors · 2026

DOI: 10.3390/bios16030145 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Biosensors, 2026. Verfasst von Ni Yan und 2 weiteren Autor:innen. Beteiligte Einrichtung: College of Electronic Information Engineering, Taiyuan University of Technology, Taiyuan 030024, China. Hauptthemen laut MEDLINE: Electroencephalography, Emotions. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, the Fundamental Research Program of Shanxi Provincee, China, Fundamental Research Program of Shanxi Province, China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To improve the accuracy of emotion recognition, this paper proposes a multi-view EEG-fNIRS and cross-attention fusion module named FGCN-TCNN-CAF, which employs a differentiated modeling strategy for the frequency, spatial, and temporal features of EEG-fNIRS signals. First, frequency-domain and time-domain features are extracted from EEG, and time-domain features are obtained from fNIRS signals. Then, a frequency-domain graph convolutional network (FGCN) and a time-domain convolutional network (TCNN) are deployed in parallel. The EEG feature views from different frequency bands are modeled using an FGCN module to capture graph-structured relationships, while the time-domain views of EEG and fNIRS are processed by a TCNN module to extract spatial and temporal features. Finally, a cross-attention fusion network (CAF) is applied to achieve interactive fusion of multimodal features. Experiments demonstrate that the proposed multi-view EEG approach achieves higher recognition accuracy compared to using only the EEG view. Additionally, the mmultimodalrecognition results outperform single-modal EEG and single-modal fNIRS by 1.73% and 6.65%, respectively. When compared with other emotion recognition models, the proposed method achieves the highest accuracy of 96.09%, proving its superior performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ElectroencephalographyEmotionsHumansSpectroscopy, Near-InfraredConvolutional Neural NetworksAttentionSignal Processing, Computer-Assisted

Stichwörter der Autor:innen

cross-attentionelectroencephalogram (EEG)emotion recognitionfunctional near-infrared spectroscopy (fNIRS)multi-view

Autor:innen und Institutionen

  • College of Electronic Information Engineering, Taiyuan University of Technology, Taiyuan 030024, China.

ORCID-Profile: Ni Yan, Guijun Chen

Förderung

  • National Natural Science Foundation of China
  • the Fundamental Research Program of Shanxi Provincee, China
  • Fundamental Research Program of Shanxi Province, China

Zitieren

APA

Yan, N., Chen, G., & Zhang, X. (2026). Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion. Biosensors. https://doi.org/10.3390/bios16030145

Vancouver

Yan N, Chen G, Zhang X. Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion. Biosensors. 2026. doi:10.3390/bios16030145

BibTeX
@article{Yan2026,
  author = {Yan, Ni and Chen, Guijun and Zhang, Xueying},
  title = {Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion},
  journal = {Biosensors},
  year = {2026},
  doi = {10.3390/bios16030145}
}
Kostenlos starten →