ViMG: a contactless deep learning framework for estimating sEMG amplitude envelopes from facial videos
Frontiers in Bioengineering and Biotechnology · 30.10.2026 · 14
DOI: 10.3389/fbioe.2026.1945313 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Bioengineering and Biotechnology, online erschienen am 30.10.2026. Verfasst von Faraz A Nizamani und 4 weiteren Autor:innen. Beteiligte Einrichtung: Systems Neuroscience and Neurotechnology Unit, Faculty of Medicine, Saarland University & School of Engineering, htw saar, Homburg/Saar, Germany. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Regional Development Fund.
Abstract (Originalsprache)
Traditional surface electromyography relies on contact electrodes that can restrict natural facial movements and cause discomfort. These limitations are particularly critical in cognitive and developmental research, where sensor placement can alter the very behavior being observed, especially in longitudinal monitoring. We present Video Myography (ViMG), an approach for the contactless estimation of window-averaged zygomaticus major sEMG envelope amplitude from facial video data. Rather than reconstructing the raw sEMG waveform, ViMG predicts a single scalar per 0.7-s video window, corresponding to the mean amplitude of the processed root-mean-square sEMG envelope over that window. Our method employs a hybrid 3D U-Net architecture integrated with a Long Short-Term Memory network intended to capture spatiotemporal dynamics of perioral facial movements. On a dataset of 23 subjects recorded in a controlled laboratory setting, we estimate window-averaged sEMG envelope amplitude over short temporal windows, achieving a mean Pearson correlation coefficient of 0.661 (range across the five folds: 0.536–0.872). A landmark-based baseline achieved comparable performance ( r = 0.670 ) , indicating that the recoverable signal is largely explained by coarse perioral kinematics and can be captured by substantially simpler models. Gradient-based saliency maps indicate that the model’s predictions are informed by anatomically plausible perioral regions. While currently limited to controlled environments, this work establishes a proof-of-concept for contactless physiological assessment and a starting point for future contactless monitoring systems.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Systems Neuroscience and Neurotechnology Unit, Faculty of Medicine, Saarland University & School of Engineering, htw saar, Homburg/Saar, Germany.
- Center for Digital Neurotechnologies Saar (CDNS), Saarbrücken, Germany.
Förderung
- European Regional Development Fund
Zitieren
APA
Nizamani, F. A., Bhamborae, M. J., Bonnaire, S., Corona-Strauss, F. I., & Strauss, D. J. (2026). ViMG: a contactless deep learning framework for estimating sEMG amplitude envelopes from facial videos. Frontiers in Bioengineering and Biotechnology, 14. https://doi.org/10.3389/fbioe.2026.1945313
Vancouver
Nizamani FA, Bhamborae MJ, Bonnaire S, Corona-Strauss FI, Strauss DJ. ViMG: a contactless deep learning framework for estimating sEMG amplitude envelopes from facial videos. Frontiers in Bioengineering and Biotechnology. 2026;14. doi:10.3389/fbioe.2026.1945313
BibTeX
@article{Nizamani2026,
author = {Nizamani, Faraz A and Bhamborae, Mayur J and Bonnaire, Sophie and Corona-Strauss, Farah I and Strauss, Daniel J},
title = {ViMG: a contactless deep learning framework for estimating sEMG amplitude envelopes from facial videos},
journal = {Frontiers in Bioengineering and Biotechnology},
year = {2026},
volume = {14},
doi = {10.3389/fbioe.2026.1945313}
}
EUVIMED