STRFLNet: Spatio-Temporal Representation Fusion Learning Network for EEG-Based Emotion Recognition
IEEE Transactions on Affective Computing · 2026-01 · 17 (1) · 204-218
DOI: 10.1109/taffc.2025.3611173 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2026-01. Verfasst von Fo Hu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 73 Literaturangaben. Gefördert von: National Key Research and Development Program of China, China Postdoctoral Science Foundation, Ningbo Science Innovation Yongjiang 2035 Key Technological Breakthrough Project.
Abstract (Originalsprache)
Electroencephalography (EEG)-based emotion recognition is essential for medical assistance and human-computer interaction. Although deep learning-based emotion recognition methods have demonstrated high performance, several challenges remain: 1) How to effectively utilize the complex dynamic-static spatial patterns inherent in emotion-related EEG signals. 2) How to hierarchically learn the latent correlations among multi-domain features. To address these challenges, a spatio-temporal representation fusion learning network (STRFLNet) is proposed to improve both the accuracy and robustness of emotion recognition using EEG signals. Specifically, dynamic-static graph topologies are constructed to capture comprehensive brain functional connectivity states, and a continuous dynamic-static graph ordinary differential equations is introduce to reveal continuous spatial patterns within EEG signals. Additionally, a hierarchical transformer fusion module is developed to fully leverage the latent correlations among multi-domain features to obtain the fused spatio-temporal representation. The experimental results on the SEED, SEED-IV, and DREAMER public EEG emotion datasets, under both subject-independent and subject-dependent settings, demonstrate that STRFLNet outperforms state-of-the-art methods in emotion recognition tasks. We further validate the effectiveness of the proposed model through interpretability analysis, which reveals the associations between the activated brain regions and corresponding emotional states. Our work highlights the significance of continuous spatial pattern learning and spatio-temporal feature fusion in emotion recognition, providing new insights for EEG-based emotion modeling.
Förderung
- National Key Research and Development Program of China
- China Postdoctoral Science Foundation
- Ningbo Science Innovation Yongjiang 2035 Key Technological Breakthrough Project
- Natural Science Foundation of Zhejiang Province
- Key Laboratory of Intelligent Processing Technology for Digital Music
- Ministry of Culture and Tourism
- National Natural Science Foundation of China
- Zhejiang Provincial Natural Science Foundation of China
Zitieren
APA
Hu, F., He, K., Wang, C., Zheng, Q., Zhou, B., Li, G., & Sun, Y. (2026). STRFLNet: Spatio-Temporal Representation Fusion Learning Network for EEG-Based Emotion Recognition. IEEE Transactions on Affective Computing, 17(1), 204-218. https://doi.org/10.1109/taffc.2025.3611173
Vancouver
Hu F, He K, Wang C, Zheng Q, Zhou B, Li G, et al. STRFLNet: Spatio-Temporal Representation Fusion Learning Network for EEG-Based Emotion Recognition. IEEE Transactions on Affective Computing. 2026;17(1):204-218. doi:10.1109/taffc.2025.3611173
BibTeX
@article{Hu2026,
author = {Hu, Fo and He, Kailun and Wang, Can and Zheng, Qinxu and Zhou, Bin and Li, Gang and Sun, Yu},
title = {STRFLNet: Spatio-Temporal Representation Fusion Learning Network for EEG-Based Emotion Recognition},
journal = {IEEE Transactions on Affective Computing},
year = {2026},
volume = {17},
number = {1},
pages = {204--218},
doi = {10.1109/taffc.2025.3611173}
}
EUVIMED