Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG
Sensors · 27.02.2024 · 24 (5) · 1536
DOI: 10.3390/s24051536 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 27.02.2024. Verfasst von Naoya Kawamura und 4 weiteren Autor:innen. Beteiligte Einrichtung: Computational Cognitive Neuroscience Laboratory, Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8501, Japan. Hauptthemen laut MEDLINE: Facial Expression, Emotions. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Science and Technology Agency-Mirai Program.
Abstract (Originalsprache)
Understanding the association between subjective emotional experiences and physiological signals is of practical and theoretical significance. Previous psychophysiological studies have shown a linear relationship between dynamic emotional valence experiences and facial electromyography (EMG) activities. However, whether and how subjective emotional valence dynamics relate to facial EMG changes nonlinearly remains unknown. To investigate this issue, we re-analyzed the data of two previous studies that measured dynamic valence ratings and facial EMG of the corrugator supercilii and zygomatic major muscles from 50 participants who viewed emotional film clips. We employed multilinear regression analyses and two nonlinear machine learning (ML) models: random forest and long short-term memory. In cross-validation, these ML models outperformed linear regression in terms of the mean squared error and correlation coefficient. Interpretation of the random forest model using the SHapley Additive exPlanation tool revealed nonlinear and interactive associations between several EMG features and subjective valence dynamics. These findings suggest that nonlinear ML models can better fit the relationship between subjective emotional valence dynamics and facial EMG than conventional linear models and highlight a nonlinear and complex relationship. The findings encourage emotion sensing using facial EMG and offer insight into the subjective–physiological association.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Computational Cognitive Neuroscience Laboratory, Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8501, Japan.
- Psychological Process Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan.
- Multimodal Data Recognition Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan.
ORCID-Profile: Wataru Sato, Tomohiro Fujita, Yasutomo Kawanishi
Förderung
- Japan Science and Technology Agency
- Japan Science and Technology Agency-Mirai Program
Zitieren
APA
Kawamura, N., Sato, W., Shimokawa, K., Fujita, T., & Kawanishi, Y. (2024). Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG. Sensors, 24(5), 1536. https://doi.org/10.3390/s24051536
Vancouver
Kawamura N, Sato W, Shimokawa K, Fujita T, Kawanishi Y. Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG. Sensors. 2024;24(5):1536. doi:10.3390/s24051536
BibTeX
@article{Kawamura2024,
author = {Kawamura, Naoya and Sato, Wataru and Shimokawa, Koh and Fujita, Tomohiro and Kawanishi, Yasutomo},
title = {Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG},
journal = {Sensors},
year = {2024},
volume = {24},
number = {5},
pages = {1536},
doi = {10.3390/s24051536}
}
EUVIMED