EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ViMG: a contactless deep learning framework for estimating sEMG amplitude envelopes from facial videos

Faraz A Nizamani, Mayur J Bhamborae, Sophie Bonnaire, Farah I Corona-Strauss, Daniel J Strauss

Frontiers in Bioengineering and Biotechnology · 30.10.2026 · 14

DOI: 10.3389/fbioe.2026.1945313 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Bioengineering and Biotechnology, online erschienen am 30.10.2026. Verfasst von Faraz A Nizamani und 4 weiteren Autor:innen. Beteiligte Einrichtung: Systems Neuroscience and Neurotechnology Unit, Faculty of Medicine, Saarland University & School of Engineering, htw saar, Homburg/Saar, Germany. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Regional Development Fund.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional surface electromyography relies on contact electrodes that can restrict natural facial movements and cause discomfort. These limitations are particularly critical in cognitive and developmental research, where sensor placement can alter the very behavior being observed, especially in longitudinal monitoring. We present Video Myography (ViMG), an approach for the contactless estimation of window-averaged zygomaticus major sEMG envelope amplitude from facial video data. Rather than reconstructing the raw sEMG waveform, ViMG predicts a single scalar per 0.7-s video window, corresponding to the mean amplitude of the processed root-mean-square sEMG envelope over that window. Our method employs a hybrid 3D U-Net architecture integrated with a Long Short-Term Memory network intended to capture spatiotemporal dynamics of perioral facial movements. On a dataset of 23 subjects recorded in a controlled laboratory setting, we estimate window-averaged sEMG envelope amplitude over short temporal windows, achieving a mean Pearson correlation coefficient of 0.661 (range across the five folds: 0.536–0.872). A landmark-based baseline achieved comparable performance ( r = 0.670 ) , indicating that the recoverable signal is largely explained by coarse perioral kinematics and can be captured by substantially simpler models. Gradient-based saliency maps indicate that the model’s predictions are informed by anatomically plausible perioral regions. While currently limited to controlled environments, this work establishes a proof-of-concept for contactless physiological assessment and a starting point for future contactless monitoring systems.

Schlagwörter

Stichwörter der Autor:innen

affective computingcontactless sensingdeep learningfacial expression analysissurface electromyography (sEMG)video myography

Autor:innen und Institutionen

  • Systems Neuroscience and Neurotechnology Unit, Faculty of Medicine, Saarland University & School of Engineering, htw saar, Homburg/Saar, Germany.
  • Center for Digital Neurotechnologies Saar (CDNS), Saarbrücken, Germany.

Förderung

  • European Regional Development Fund

Zitieren

APA

Nizamani, F. A., Bhamborae, M. J., Bonnaire, S., Corona-Strauss, F. I., & Strauss, D. J. (2026). ViMG: a contactless deep learning framework for estimating sEMG amplitude envelopes from facial videos. Frontiers in Bioengineering and Biotechnology, 14. https://doi.org/10.3389/fbioe.2026.1945313

Vancouver

Nizamani FA, Bhamborae MJ, Bonnaire S, Corona-Strauss FI, Strauss DJ. ViMG: a contactless deep learning framework for estimating sEMG amplitude envelopes from facial videos. Frontiers in Bioengineering and Biotechnology. 2026;14. doi:10.3389/fbioe.2026.1945313

BibTeX
@article{Nizamani2026,
  author = {Nizamani, Faraz A and Bhamborae, Mayur J and Bonnaire, Sophie and Corona-Strauss, Farah I and Strauss, Daniel J},
  title = {ViMG: a contactless deep learning framework for estimating sEMG amplitude envelopes from facial videos},
  journal = {Frontiers in Bioengineering and Biotechnology},
  year = {2026},
  volume = {14},
  doi = {10.3389/fbioe.2026.1945313}
}
Kostenlos starten →