Optimal processing of surface facial EMG to identify emotional expressions: A data-driven approach
Behavior Research Methods · 21.05.2024 · 56 (7) · 7331-7344
DOI: 10.3758/s13428-024-02421-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift Behavior Research Methods, online erschienen am 21.05.2024. Verfasst von J M Rutkowska und 6 weiteren Autor:innen. Beteiligte Einrichtung: Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands. Hauptthemen laut MEDLINE: Electromyography, Facial Expression, Emotions, Facial Muscles. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Horizon 2020 Framework Programme.
Abstract (Originalsprache)
Surface facial electromyography (EMG) is commonly used to detect emotions from subtle facial expressions. Although there are established procedures for collecting EMG data and some aspects of their processing, there is little agreement among researchers about the optimal way to process the EMG signal, so that the study-unrelated variability (noise) is removed, and the emotion-related variability is best detected. The aim of the current paper was to establish an optimal processing pipeline for EMG data for identifying emotional expressions in facial muscles. We identified the most common processing steps from existing literature and created 72 processing pipelines that represented all the different processing choices. We applied these pipelines to a previously published dataset from a facial mimicry experiment, where 100 adult participants observed happy and sad facial expressions, whilst the activity of their facial muscles, zygomaticus major and corrugator supercilii , was recorded with EMG. We used a resampling approach and subsets of the original data to investigate the effect and robustness of different processing choices on the performance of a logistic regression model that predicted the mimicked emotion (happy/sad) from the EMG signal. In addition, we used a random forest model to identify the most important processing steps for the sensitivity of the logistic regression model. Three processing steps were found to be most impactful: baseline correction, standardisation within muscles, and standardisation within subjects. The chosen feature of interest and the signal averaging had little influence on the sensitivity to the effect. We recommend an optimal processing pipeline, share our code and data, and provide a step-by-step walkthrough for researchers.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
- Department of Psychology, University of Zurich, Zurich, Switzerland.
- Jacobs Center for Productive Youth Development, University of Zurich, Zurich, Switzerland.
- Centre for Brain and Cognitive Development, Department of Psychological Sciences, Birkbeck, University of London, London, UK.
- Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
- Department of Psychology, New York University - Abu Dhabi, Abu Dhabi, United Arab Emirates.
Förderung
- Horizon 2020 Framework Programme
Zitieren
APA
Rutkowska, J. M., Ghilardi, T., Vacaru, S. V., van Schaik, J. E., Meyer, M., Hunnius, S., & Oostenveld, R. (2024). Optimal processing of surface facial EMG to identify emotional expressions: A data-driven approach. Behavior Research Methods, 56(7), 7331-7344. https://doi.org/10.3758/s13428-024-02421-4
Vancouver
Rutkowska JM, Ghilardi T, Vacaru SV, van Schaik JE, Meyer M, Hunnius S, et al. Optimal processing of surface facial EMG to identify emotional expressions: A data-driven approach. Behavior Research Methods. 2024;56(7):7331-7344. doi:10.3758/s13428-024-02421-4
BibTeX
@article{Rutkowska2024,
author = {Rutkowska, J M and Ghilardi, T and Vacaru, S V and van Schaik, J E and Meyer, M and Hunnius, S and Oostenveld, R},
title = {Optimal processing of surface facial EMG to identify emotional expressions: A data-driven approach},
journal = {Behavior Research Methods},
year = {2024},
volume = {56},
number = {7},
pages = {7331--7344},
doi = {10.3758/s13428-024-02421-4}
}
EUVIMED