Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding
Sensors · 2023
DOI: 10.3390/s23229076 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Chun-Ting Hsu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Psychological Process Research Team, Guardian Robot Project, RIKEN, Soraku-gun, Kyoto 619-0288, Japan. Hauptthemen laut MEDLINE: Facial Expression, Face. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Science and Technology Agency Mirai Program, JST CREST.
Abstract (Originalsprache)
Although electromyography (EMG) remains the standard, researchers have begun using automated facial action coding system (FACS) software to evaluate spontaneous facial mimicry despite the lack of evidence of its validity. Using the facial EMG of the zygomaticus major (ZM) as a standard, we confirmed the detection of spontaneous facial mimicry in action unit 12 (AU12, lip corner puller) via an automated FACS. Participants were alternately presented with real-time model performance and prerecorded videos of dynamic facial expressions, while simultaneous ZM signal and frontal facial videos were acquired. Facial videos were estimated for AU12 using FaceReader, Py-Feat, and OpenFace. The automated FACS is less sensitive and less accurate than facial EMG, but AU12 mimicking responses were significantly correlated with ZM responses. All three software programs detected enhanced facial mimicry by live performances. The AU12 time series showed a roughly 100 to 300 ms latency relative to the ZM. Our results suggested that while the automated FACS could not replace facial EMG in mimicry detection, it could serve a purpose for large effect sizes. Researchers should be cautious with the automated FACS outputs, especially when studying clinical populations. In addition, developers should consider the EMG validation of AU estimation as a benchmark.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Psychological Process Research Team, Guardian Robot Project, RIKEN, Soraku-gun, Kyoto 619-0288, Japan.
ORCID-Profile: Chun-Ting Hsu, Wataru Sato
Förderung
- Japan Science and Technology Agency
- Japan Science and Technology Agency Mirai Program
- JST CREST
Zitieren
APA
Hsu, C. T., & Sato, W. (2023). Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding. Sensors. https://doi.org/10.3390/s23229076
Vancouver
Hsu CT, Sato W. Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding. Sensors. 2023. doi:10.3390/s23229076
BibTeX
@article{Hsu2023,
author = {Hsu, Chun-Ting and Sato, Wataru},
title = {Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23229076}
}
EUVIMED