Measuring lip movement outside the laboratory using face-tracked digital video
The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A195-A195
DOI: 10.1121/10.0040575 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Peter A. Krause.
Abstract (Originalsprache)
Direct measurement of speech articulation can furnish information unavailable from the acoustic signal. Historically, articulatory measurement required running participants in a laboratory using specialized (and often expensive) equipment. Recent advances in markerless pose estimation allow measuring lip articulation from simple digital video. While video does not afford the millimeter precision or multi-articulator imaging offered by other approaches, it is accessible, portable, and requires no special preparation (e.g., sensor application). This talk will review techniques co-developed by the author to be used with publicly available, cost-free face-trackers (OpenFace 2.0 and Google MediaPipe’s FaceMesh module). The talk will use two recent studies to showcase how these techniques can be deployed under quite unusual conditions. In the first study [Broś & Krause, 2024], a laptop with webcam was used to obtain field recordings of native Gran Canarian Spanish speech, inside participants’ homes. Analysis revealed important articulatory correlates of obstruent lenition. In the second study [Krause & Tilsen, in prep], American English speakers participated remotely over the Internet, while their lip movements were tracked through their own webcams. Preliminary results from this study offer novel insights into the labial motor control strategies used for both labial and non-labial consonants.
Zitieren
APA
Krause, P. A. (2025). Measuring lip movement outside the laboratory using face-tracked digital video. The Journal of the Acoustical Society of America, 158(4_Supplement), A195-A195. https://doi.org/10.1121/10.0040575
Vancouver
Krause PA. Measuring lip movement outside the laboratory using face-tracked digital video. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A195-A195. doi:10.1121/10.0040575
BibTeX
@article{Krause2025,
author = {Krause, Peter A.},
title = {Measuring lip movement outside the laboratory using face-tracked digital video},
journal = {The Journal of the Acoustical Society of America},
year = {2025},
volume = {158},
number = {4_Supplement},
pages = {A195--A195},
doi = {10.1121/10.0040575}
}
EUVIMED