EmotionMIL: An End-to-End Multiple Instance Learning Framework for Emotion Recognition From EEG Signals
IEEE Transactions on Affective Computing · 2025-10 · 16 (4) · 3231-3247
DOI: 10.1109/taffc.2025.3581388 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2025-10. Verfasst von Jun Xiao und 9 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: STI 2030-Major project, National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province.
Abstract (Originalsprache)
Emotion recognition from EEG signals offers significant advantages in affective computing, as EEG more accurately reflects internal emotional states than other modalities, such as facial expressions or peripheral physiological signals. Modeling and capturing subtle affective changes over time is crucial for real-world applications to achieve better human-computer interaction. However, training such models usually requires segment-level emotion labels, which are costly and may not be feasible. Assigning the overall label to all EEG segments within a trial can lead to inaccurate model training and degraded performance, as emotions evolve continuously. This highlights the need for models capable of learning from trial-wise emotion labels while capturing temporal dynamics of emotional responses within each segment because trial-wise post-stimulus labels are more accessible. To this end, we propose EmotionMIL, an end-to-end EEG-based emotion recognition framework that leverages recent advances in deep multiple instance learning (MIL). This framework enables robust emotion recognition from weakly labeled EEG signals and identifies the most prominent emotional responses. EmotionMIL captures the temporal dynamics of emotions using a retentive self-attention mechanism, which adaptively assigns weights to EEG segments based on their relevance in predicting the overall emotion label. A pseudo-bag augmentation strategy is also introduced to enhance the model's generalization ability by generating additional pseudo-bags from the original ones. Evaluated on three benchmark datasets—DEAP, DREAMER, and SEED—EmotionMIL outperforms state-of-the-art non-MIL and MIL models in both subject-dependent and subject-independent tasks, achieving superior accuracy and F1-score. Ablation study further validates the model design, while visualization results demonstrate that EmotionMIL effectively identifies both spatial EEG patterns and temporal emotional dynamics. These findings underscore EmotionMIL's potential for robust, interpretable emotion recognition, paving the way for real-world applications in emotion-aware systems. The code is available athttps://github.com/yuty2009/emotionmil.
Förderung
- STI 2030-Major project
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Xiao, J., Qi, F., Wang, L., He, Y., Yu, J., Wu, W., Yu, Z., Li, Y., Gu, Z., & Yu, T. (2025). EmotionMIL: An End-to-End Multiple Instance Learning Framework for Emotion Recognition From EEG Signals. IEEE Transactions on Affective Computing, 16(4), 3231-3247. https://doi.org/10.1109/taffc.2025.3581388
Vancouver
Xiao J, Qi F, Wang L, He Y, Yu J, Wu W, et al. EmotionMIL: An End-to-End Multiple Instance Learning Framework for Emotion Recognition From EEG Signals. IEEE Transactions on Affective Computing. 2025;16(4):3231-3247. doi:10.1109/taffc.2025.3581388
BibTeX
@article{Xiao2025,
author = {Xiao, Jun and Qi, Feifei and Wang, Lingli and He, Yanbin and Yu, Jingang and Wu, Wei and Yu, Zhuliang and Li, Yuanqing and Gu, Zhenghui and Yu, Tianyou},
title = {EmotionMIL: An End-to-End Multiple Instance Learning Framework for Emotion Recognition From EEG Signals},
journal = {IEEE Transactions on Affective Computing},
year = {2025},
volume = {16},
number = {4},
pages = {3231--3247},
doi = {10.1109/taffc.2025.3581388}
}
EUVIMED