Fusion of Multi-domain EEG Signatures Improves Emotion Recognition
Journal of Integrative Neuroscience · 19.01.2024 · 23 (1)
DOI: 10.31083/j.jin2301018 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Integrative Neuroscience, online erschienen am 19.01.2024. Verfasst von Xiaomin Wang und 8 weiteren Autor:innen. Beteiligte Einrichtung: Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China. Hauptthemen laut MEDLINE: Emotions, Fear. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Background
Affective computing has gained increasing attention in the area of the human-computer interface where electroencephalography (EEG)-based emotion recognition occupies an important position. Nevertheless, the diversity of emotions and the complexity of EEG signals result in unexplored relationships between emotion and multichannel EEG signal frequency, as well as spatial and temporal information.
Methods
Audio-video stimulus materials were used that elicited four types of emotions (sad, fearful, happy, neutral) in 32 male and female subjects (age 21–42 years) while collecting EEG signals. We developed a multidimensional analysis framework using a fusion of phase-locking value (PLV), microstates, and power spectral densities (PSDs) of EEG features to improve emotion recognition.
Results
An increasing trend of PSDs was observed as emotional valence increased, and connections in the prefrontal, temporal, and occipital lobes in high-frequency bands showed more differentiation between emotions. Transition probability between microstates was likely related to emotional valence. The average cross-subject classification accuracy of features fused by Discriminant Correlation Analysis achieved 64.69%, higher than that of single mode and direct-concatenated features, with an increase of more than 7%.
Conclusions
Different types of EEG features have complementary properties in emotion recognition, and combining EEG data from three types of features in a correlated way, improves the performance of emotion classification.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China.
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300450 Tianjin, China.
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Wang, X., Pei, Y., Luo, Z., Zhao, S., Xie, L., Yan, Y., Yin, E., Liu, S., & Ming, D. (2024). Fusion of Multi-domain EEG Signatures Improves Emotion Recognition. Journal of Integrative Neuroscience, 23(1). https://doi.org/10.31083/j.jin2301018
Vancouver
Wang X, Pei Y, Luo Z, Zhao S, Xie L, Yan Y, et al. Fusion of Multi-domain EEG Signatures Improves Emotion Recognition. Journal of Integrative Neuroscience. 2024;23(1). doi:10.31083/j.jin2301018
BibTeX
@article{Wang2024,
author = {Wang, Xiaomin and Pei, Yu and Luo, Zhiguo and Zhao, Shaokai and Xie, Liang and Yan, Ye and Yin, Erwei and Liu, Shuang and Ming, Dong},
title = {Fusion of Multi-domain EEG Signatures Improves Emotion Recognition},
journal = {Journal of Integrative Neuroscience},
year = {2024},
volume = {23},
number = {1},
doi = {10.31083/j.jin2301018}
}
EUVIMED