EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding

Chun-Ting Hsu iD, Wataru Sato iD

Sensors · 2023

DOI: 10.3390/s23229076 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Chun-Ting Hsu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Psychological Process Research Team, Guardian Robot Project, RIKEN, Soraku-gun, Kyoto 619-0288, Japan. Hauptthemen laut MEDLINE: Facial Expression, Face. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Science and Technology Agency Mirai Program, JST CREST.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Although electromyography (EMG) remains the standard, researchers have begun using automated facial action coding system (FACS) software to evaluate spontaneous facial mimicry despite the lack of evidence of its validity. Using the facial EMG of the zygomaticus major (ZM) as a standard, we confirmed the detection of spontaneous facial mimicry in action unit 12 (AU12, lip corner puller) via an automated FACS. Participants were alternately presented with real-time model performance and prerecorded videos of dynamic facial expressions, while simultaneous ZM signal and frontal facial videos were acquired. Facial videos were estimated for AU12 using FaceReader, Py-Feat, and OpenFace. The automated FACS is less sensitive and less accurate than facial EMG, but AU12 mimicking responses were significantly correlated with ZM responses. All three software programs detected enhanced facial mimicry by live performances. The AU12 time series showed a roughly 100 to 300 ms latency relative to the ZM. Our results suggested that while the automated FACS could not replace facial EMG in mimicry detection, it could serve a purpose for large effect sizes. Researchers should be cautious with the automated FACS outputs, especially when studying clinical populations. In addition, developers should consider the EMG validation of AU estimation as a benchmark.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial ExpressionFaceHumansFacial MusclesElectromyographyVideotape RecordingEmotions

Stichwörter der Autor:innen

FaceReaderOpenFacePy-Featcross-correlationelectromyographyfacial action coding systemspontaneous facial mimicry

Autor:innen und Institutionen

  • Psychological Process Research Team, Guardian Robot Project, RIKEN, Soraku-gun, Kyoto 619-0288, Japan.

ORCID-Profile: Chun-Ting Hsu, Wataru Sato

Förderung

  • Japan Science and Technology Agency
  • Japan Science and Technology Agency Mirai Program
  • JST CREST

Zitieren

APA

Hsu, C. T., & Sato, W. (2023). Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding. Sensors. https://doi.org/10.3390/s23229076

Vancouver

Hsu CT, Sato W. Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding. Sensors. 2023. doi:10.3390/s23229076

BibTeX
@article{Hsu2023,
  author = {Hsu, Chun-Ting and Sato, Wataru},
  title = {Electromyographic Validation of Spontaneous Facial Mimicry Detection Using Automated Facial Action Coding},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23229076}
}
Kostenlos starten →