Automatic Motion Tracking of Lips using Digital Video and OpenFace 2.0
Laboratory Phonology: Journal of the Association for Laboratory Phonology · 2020-07-07 · 11 (1) · 9
DOI: 10.5334/labphon.232 ↗At a glance
Journal article in Laboratory Phonology: Journal of the Association for Laboratory Phonology, published online on 2020-07-07. Written by Peter A. Krause and 2 co-authors. Cited 17 times so far (Crossref); 27 references. The full text is freely available (open access, CC BY 4.0).
Abstract (original language)
Because the lips are external organs, they can be easily observed by means that are non-invasive, including simple video recording. The current paper introduces a free-of-charge, highly portable, automatic solution for extracting oral posture from digital video, based on an existing facetracking utility. We describe how this solution might benefit various lines of laboratory phonology research, including analysis of articulatory coordination and audiovisual speech, as well as phonetic fieldwork. We then provide a tutorial, framed as a simple experiment in metronomic speech. The tutorial describes how to configure the software to work with one’s digital camera of choice, how to extract relevant articulatory parameters from the face tracker, and how to approach statistical analysis. We have supplied pre-written Python scripts to aid the reader in following along with the experiment. The portability, ease, and affordability of the described solution have important implications for the accessibility of articulatory measurement, both in the lab and out in the field.
Cite
APA
Krause, P. A., Kay, C. A., & Kawamoto, A. H. (2020). Automatic Motion Tracking of Lips using Digital Video and OpenFace 2.0. Laboratory Phonology: Journal of the Association for Laboratory Phonology, 11(1), 9. https://doi.org/10.5334/labphon.232
Vancouver
Krause PA, Kay CA, Kawamoto AH. Automatic Motion Tracking of Lips using Digital Video and OpenFace 2.0. Laboratory Phonology: Journal of the Association for Laboratory Phonology. 2020;11(1):9. doi:10.5334/labphon.232
BibTeX
@article{Krause2020,
author = {Krause, Peter A. and Kay, Christopher A. and Kawamoto, Alan H.},
title = {Automatic Motion Tracking of Lips using Digital Video and OpenFace 2.0},
journal = {Laboratory Phonology: Journal of the Association for Laboratory Phonology},
year = {2020},
volume = {11},
number = {1},
pages = {9},
doi = {10.5334/labphon.232}
}
EUVIMED