EUVIMEDEUVIMED entdecken
Crossref

SEED-VII: A Multimodal Dataset of Six Basic Emotions With Continuous Labels for Emotion Recognition

Wei-Bang Jiang, Xuan-Hao Liu, Wei-Long Zheng, Bao-Liang Lu

IEEE Transactions on Affective Computing · 2025-04 · 16 (2) · 969-985

DOI: 10.1109/taffc.2024.3485057 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2025-04. Verfasst von Wei-Bang Jiang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 71-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: STI 2030-Major Projects, National Natural Science Foundation of China, Shanghai Municipal Science and Technology Major Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recognizing emotions from physiological signals is a topic that has garnered widespread interest, and research continues to develop novel techniques for perceiving emotions. However, the emergence of deep learning has highlighted the need for comprehensive and high-quality emotional datasets that enable the accurate decoding of human emotions. To systematically explore human emotions, we develop a multimodal dataset consisting of six basic (happiness, sadness, fear, disgust, surprise, and anger) emotions and the neutral emotion, named SEED-VII. This multimodal dataset includes electroencephalography (EEG) and eye movement signals. The seven emotions in SEED-VII are elicited by 80 different videos and fully investigated with continuous labels that indicate the intensity levels of the corresponding emotions. Additionally, we propose a novel Multimodal Adaptive Emotion Transformer (MAET), that can flexibly process both unimodal and multimodal inputs. Adversarial training is utilized in the MAET to mitigate subject discrepancies, which enhances domain generalization. Our extensive experiments, encompassing both subject-dependent and cross-subject conditions, demonstrate the superior performance of the MAET in terms of handling various inputs. Continuous labels are used to filter the data with high emotional intensity, and this strategy is proven to be effective for attaining improved emotion recognition performance. Furthermore, complementary properties between the EEG signals and eye movements and stable neural patterns of the seven emotions are observed.

Förderung

  • STI 2030-Major Projects
  • National Natural Science Foundation of China
  • Shanghai Municipal Science and Technology Major Project
  • Medical-Engineering Interdisciplinary Research Foundation of Shanghai Jiao Tong University
  • Shanghai Pilot Program for Basic Research
  • GuangCi Professorship Program of RuiJin Hospital Shanghai Jiao Tong University

Zitieren

APA

Jiang, W., Liu, X., Zheng, W., & Lu, B. (2025). SEED-VII: A Multimodal Dataset of Six Basic Emotions With Continuous Labels for Emotion Recognition. IEEE Transactions on Affective Computing, 16(2), 969-985. https://doi.org/10.1109/taffc.2024.3485057

Vancouver

Jiang W, Liu X, Zheng W, Lu B. SEED-VII: A Multimodal Dataset of Six Basic Emotions With Continuous Labels for Emotion Recognition. IEEE Transactions on Affective Computing. 2025;16(2):969-985. doi:10.1109/taffc.2024.3485057

BibTeX
@article{Jiang2025,
  author = {Jiang, Wei-Bang and Liu, Xuan-Hao and Zheng, Wei-Long and Lu, Bao-Liang},
  title = {SEED-VII: A Multimodal Dataset of Six Basic Emotions With Continuous Labels for Emotion Recognition},
  journal = {IEEE Transactions on Affective Computing},
  year = {2025},
  volume = {16},
  number = {2},
  pages = {969--985},
  doi = {10.1109/taffc.2024.3485057}
}
Kostenlos starten →