AMDET: Attention Based Multiple Dimensions EEG Transformer for Emotion Recognition
IEEE Transactions on Affective Computing · 2024-07 · 15 (3) · 1067-1077
DOI: 10.1109/taffc.2023.3318321 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2024-07. Verfasst von Yongling Xu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 83-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Key R&D Program of China, Key-Area Research and Development Program of Guangdong Province.
Abstract (Originalsprache)
Affective computing is an important subfield of artificial intelligence, and with the rapid development of brain-computer interface technology, emotion recognition based on EEG signals has received broad attention. It is still a great challenge to effectively explore the multi-dimensional information in the EEG data in spite of a large number of deep learning methods. In this paper, we propose a deep learning model called Attention-based Multiple Dimensions EEG Transformer (AMDET), which can leverage the complementarity among the spectral-spatial-temporal features of EEG data by employing the multi-dimensional global attention mechanism. We first transform the original EEG data into 3D temporal-spectral-spatial representations and then the AMDET would use spectral-spatial transformer blocks to extract effective features in the EEG signal and focus on the critical time frame with the temporal attention block. We conduct extensive experiments on the DEAP, SEED, and SEED-IV datasets to evaluate the performance of AMDET and the results outperform the state-of-the-art baseline on three datasets. Accuracy rates of 97.48%, 96.85%, 97.17%, 87.32% were achieved in the DEAP-Arousal, DEAP-Valence, SEED, and SEED-IV datasets, respectively. Based on AMDET, we can achieve over 90% accuracy with only eight channels, significantly improving the possibility of practical applications.
Förderung
- National Key R&D Program of China
- Key-Area Research and Development Program of Guangdong Province
Zitieren
APA
Xu, Y., Du, Y., Li, L., Lai, H., Zou, J., Zhou, T., Xiao, L., Liu, L., & Ma, P. (2024). AMDET: Attention Based Multiple Dimensions EEG Transformer for Emotion Recognition. IEEE Transactions on Affective Computing, 15(3), 1067-1077. https://doi.org/10.1109/taffc.2023.3318321
Vancouver
Xu Y, Du Y, Li L, Lai H, Zou J, Zhou T, et al. AMDET: Attention Based Multiple Dimensions EEG Transformer for Emotion Recognition. IEEE Transactions on Affective Computing. 2024;15(3):1067-1077. doi:10.1109/taffc.2023.3318321
BibTeX
@article{Xu2024,
author = {Xu, Yongling and Du, Yang and Li, Ling and Lai, Honghao and Zou, Jing and Zhou, Tianying and Xiao, Lushan and Liu, Li and Ma, Pengcheng},
title = {AMDET: Attention Based Multiple Dimensions EEG Transformer for Emotion Recognition},
journal = {IEEE Transactions on Affective Computing},
year = {2024},
volume = {15},
number = {3},
pages = {1067--1077},
doi = {10.1109/taffc.2023.3318321}
}
EUVIMED