EUVIMEDEUVIMED entdecken
Crossref

EmotionMIL: An End-to-End Multiple Instance Learning Framework for Emotion Recognition From EEG Signals

Jun Xiao, Feifei Qi, Lingli Wang, Yanbin He, Jingang Yu, Wei Wu, Zhuliang Yu, Yuanqing Li, Zhenghui Gu, Tianyou Yu

IEEE Transactions on Affective Computing · 2025-10 · 16 (4) · 3231-3247

DOI: 10.1109/taffc.2025.3581388 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2025-10. Verfasst von Jun Xiao und 9 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: STI 2030-Major project, National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotion recognition from EEG signals offers significant advantages in affective computing, as EEG more accurately reflects internal emotional states than other modalities, such as facial expressions or peripheral physiological signals. Modeling and capturing subtle affective changes over time is crucial for real-world applications to achieve better human-computer interaction. However, training such models usually requires segment-level emotion labels, which are costly and may not be feasible. Assigning the overall label to all EEG segments within a trial can lead to inaccurate model training and degraded performance, as emotions evolve continuously. This highlights the need for models capable of learning from trial-wise emotion labels while capturing temporal dynamics of emotional responses within each segment because trial-wise post-stimulus labels are more accessible. To this end, we propose EmotionMIL, an end-to-end EEG-based emotion recognition framework that leverages recent advances in deep multiple instance learning (MIL). This framework enables robust emotion recognition from weakly labeled EEG signals and identifies the most prominent emotional responses. EmotionMIL captures the temporal dynamics of emotions using a retentive self-attention mechanism, which adaptively assigns weights to EEG segments based on their relevance in predicting the overall emotion label. A pseudo-bag augmentation strategy is also introduced to enhance the model's generalization ability by generating additional pseudo-bags from the original ones. Evaluated on three benchmark datasets—DEAP, DREAMER, and SEED—EmotionMIL outperforms state-of-the-art non-MIL and MIL models in both subject-dependent and subject-independent tasks, achieving superior accuracy and F1-score. Ablation study further validates the model design, while visualization results demonstrate that EmotionMIL effectively identifies both spatial EEG patterns and temporal emotional dynamics. These findings underscore EmotionMIL's potential for robust, interpretable emotion recognition, paving the way for real-world applications in emotion-aware systems. The code is available athttps://github.com/yuty2009/emotionmil.

Förderung

  • STI 2030-Major project
  • National Natural Science Foundation of China
  • Basic and Applied Basic Research Foundation of Guangdong Province

Zitieren

APA

Xiao, J., Qi, F., Wang, L., He, Y., Yu, J., Wu, W., Yu, Z., Li, Y., Gu, Z., & Yu, T. (2025). EmotionMIL: An End-to-End Multiple Instance Learning Framework for Emotion Recognition From EEG Signals. IEEE Transactions on Affective Computing, 16(4), 3231-3247. https://doi.org/10.1109/taffc.2025.3581388

Vancouver

Xiao J, Qi F, Wang L, He Y, Yu J, Wu W, et al. EmotionMIL: An End-to-End Multiple Instance Learning Framework for Emotion Recognition From EEG Signals. IEEE Transactions on Affective Computing. 2025;16(4):3231-3247. doi:10.1109/taffc.2025.3581388

BibTeX
@article{Xiao2025,
  author = {Xiao, Jun and Qi, Feifei and Wang, Lingli and He, Yanbin and Yu, Jingang and Wu, Wei and Yu, Zhuliang and Li, Yuanqing and Gu, Zhenghui and Yu, Tianyou},
  title = {EmotionMIL: An End-to-End Multiple Instance Learning Framework for Emotion Recognition From EEG Signals},
  journal = {IEEE Transactions on Affective Computing},
  year = {2025},
  volume = {16},
  number = {4},
  pages = {3231--3247},
  doi = {10.1109/taffc.2025.3581388}
}
Kostenlos starten →