Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion
Biosensors · 2026
DOI: 10.3390/bios16030145 ↗Kurz gefasst
Fachartikel in der Zeitschrift Biosensors, 2026. Verfasst von Ni Yan und 2 weiteren Autor:innen. Beteiligte Einrichtung: College of Electronic Information Engineering, Taiyuan University of Technology, Taiyuan 030024, China. Hauptthemen laut MEDLINE: Electroencephalography, Emotions. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, the Fundamental Research Program of Shanxi Provincee, China, Fundamental Research Program of Shanxi Province, China.
Abstract (Originalsprache)
To improve the accuracy of emotion recognition, this paper proposes a multi-view EEG-fNIRS and cross-attention fusion module named FGCN-TCNN-CAF, which employs a differentiated modeling strategy for the frequency, spatial, and temporal features of EEG-fNIRS signals. First, frequency-domain and time-domain features are extracted from EEG, and time-domain features are obtained from fNIRS signals. Then, a frequency-domain graph convolutional network (FGCN) and a time-domain convolutional network (TCNN) are deployed in parallel. The EEG feature views from different frequency bands are modeled using an FGCN module to capture graph-structured relationships, while the time-domain views of EEG and fNIRS are processed by a TCNN module to extract spatial and temporal features. Finally, a cross-attention fusion network (CAF) is applied to achieve interactive fusion of multimodal features. Experiments demonstrate that the proposed multi-view EEG approach achieves higher recognition accuracy compared to using only the EEG view. Additionally, the mmultimodalrecognition results outperform single-modal EEG and single-modal fNIRS by 1.73% and 6.65%, respectively. When compared with other emotion recognition models, the proposed method achieves the highest accuracy of 96.09%, proving its superior performance.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Electronic Information Engineering, Taiyuan University of Technology, Taiyuan 030024, China.
ORCID-Profile: Ni Yan, Guijun Chen
Förderung
- National Natural Science Foundation of China
- the Fundamental Research Program of Shanxi Provincee, China
- Fundamental Research Program of Shanxi Province, China
Zitieren
APA
Yan, N., Chen, G., & Zhang, X. (2026). Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion. Biosensors. https://doi.org/10.3390/bios16030145
Vancouver
Yan N, Chen G, Zhang X. Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion. Biosensors. 2026. doi:10.3390/bios16030145
BibTeX
@article{Yan2026,
author = {Yan, Ni and Chen, Guijun and Zhang, Xueying},
title = {Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion},
journal = {Biosensors},
year = {2026},
doi = {10.3390/bios16030145}
}
EUVIMED