EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG

Naoya Kawamura, Wataru Sato iD, Koh Shimokawa, Tomohiro Fujita iD, Yasutomo Kawanishi iD

Sensors · 27.02.2024 · 24 (5) · 1536

DOI: 10.3390/s24051536 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 27.02.2024. Verfasst von Naoya Kawamura und 4 weiteren Autor:innen. Beteiligte Einrichtung: Computational Cognitive Neuroscience Laboratory, Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8501, Japan. Hauptthemen laut MEDLINE: Facial Expression, Emotions. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Science and Technology Agency-Mirai Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Understanding the association between subjective emotional experiences and physiological signals is of practical and theoretical significance. Previous psychophysiological studies have shown a linear relationship between dynamic emotional valence experiences and facial electromyography (EMG) activities. However, whether and how subjective emotional valence dynamics relate to facial EMG changes nonlinearly remains unknown. To investigate this issue, we re-analyzed the data of two previous studies that measured dynamic valence ratings and facial EMG of the corrugator supercilii and zygomatic major muscles from 50 participants who viewed emotional film clips. We employed multilinear regression analyses and two nonlinear machine learning (ML) models: random forest and long short-term memory. In cross-validation, these ML models outperformed linear regression in terms of the mean squared error and correlation coefficient. Interpretation of the random forest model using the SHapley Additive exPlanation tool revealed nonlinear and interactive associations between several EMG features and subjective valence dynamics. These findings suggest that nonlinear ML models can better fit the relationship between subjective emotional valence dynamics and facial EMG than conventional linear models and highlight a nonlinear and complex relationship. The findings encourage emotion sensing using facial EMG and offer insight into the subjective–physiological association.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial ExpressionEmotionsHumansElectromyographyFaceFacial MusclesMachine Learning

Stichwörter der Autor:innen

SHapley Additive exPlanation (SHAP)facial electromyography (EMG)long short-term memory (LSTM)random forest regressionvalence

Autor:innen und Institutionen

  • Computational Cognitive Neuroscience Laboratory, Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Sakyo, Kyoto 606-8501, Japan.
  • Psychological Process Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan.
  • Multimodal Data Recognition Research Team, Guardian Robot Project, RIKEN, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan.

ORCID-Profile: Wataru Sato, Tomohiro Fujita, Yasutomo Kawanishi

Förderung

  • Japan Science and Technology Agency
  • Japan Science and Technology Agency-Mirai Program

Zitieren

APA

Kawamura, N., Sato, W., Shimokawa, K., Fujita, T., & Kawanishi, Y. (2024). Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG. Sensors, 24(5), 1536. https://doi.org/10.3390/s24051536

Vancouver

Kawamura N, Sato W, Shimokawa K, Fujita T, Kawanishi Y. Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG. Sensors. 2024;24(5):1536. doi:10.3390/s24051536

BibTeX
@article{Kawamura2024,
  author = {Kawamura, Naoya and Sato, Wataru and Shimokawa, Koh and Fujita, Tomohiro and Kawanishi, Yasutomo},
  title = {Machine Learning-Based Interpretable Modeling for Subjective Emotional Dynamics Sensing Using Facial EMG},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {5},
  pages = {1536},
  doi = {10.3390/s24051536}
}
Kostenlos starten →