Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints
Physiological Measurement · 29.05.2026 · 47 (5) · 055011
DOI: 10.1088/1361-6579/ae669e ↗Kurz gefasst
Fachartikel in der Zeitschrift Physiological Measurement, online erschienen am 12.05.2026. Verfasst von Francesco Latino und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy. Hauptthemen laut MEDLINE: Facial Expression, Electric Capacitance, Wearable Electronic Devices, Eyeglasses. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective. Wearable facial expression recognition requires sensing modalities that are unobtrusive, illumination-independent, and compatible with everyday eyewear form factors. Existing optical and electromyographic approaches are limited by line-of-sight requirements, skin contact, or restricted action unit (AU) coverage. This work investigates the feasibility of non-contact capacitive sensing for facial muscle activity monitoring within the strict geometric constraints of standard eyewear. Approach. We developed FERGlasses, integrating eight loading-mode capacitive channels via a custom flexible PCB and active shielding to detect skin-to-frame displacement. A validation study with 40 participants was conducted to elicit seven facial action coding system-defined AUs. Signal fidelity was assessed using independent Random Forest regressors and benchmarked against commercial optical-proximity (OCOsense) and computer-vision (Py-Feat) standards. Main results. The system demonstrated high agreement for upper-face activity, achieving median cosine similarities of 0.97 for the Outer Brow Raiser (AU02) and 0.87 for the Nose Wrinkler (AU09), while lower-face actions such as the Chin Raiser (AU17) yielded a median of 0.33, consistent with mechanical signal attenuation along the frame. Channel-ablation analysis quantified the specific anatomical contributions of each electrode group, identifying eyebrow and rhinion sensors as primary signal drivers for upper-face and perinasal actions, respectively, and temple sensors as critical for cheek raiser detection. Significance. This study provides the first metrological validation of multi-channel capacitive sensing for AU-level recognition in eyewear. The results establish the modality as a robust, privacy-preserving, and illumination-independent alternative to optical methods for longitudinal physiological monitoring, with the current prototype serving as a wired research platform and full consumer-grade integration identified as a future engineering objective.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy.
- Smart Eyewear Laboratory, EssilorLuxottica, Milan, Italy.
- Department of Industrial and Information Engineering, Università di Pavia, Pave, Italy.
ORCID-Profile: Francesco Latino, Matteo Rossi, Andrea Costanzo Palmisciano, Andrea Farabbi, Athul Krishnan, Niccolò Antonello, Luca Mainardi, Pietro Cerveri
Zitieren
APA
Latino, F., Rossi, M., Palmisciano, A. C., Farabbi, A., Krishnan, A., Antonello, N., Mainardi, L., & Cerveri, P. (2026). Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints. Physiological Measurement, 47(5), 055011. https://doi.org/10.1088/1361-6579/ae669e
Vancouver
Latino F, Rossi M, Palmisciano AC, Farabbi A, Krishnan A, Antonello N, et al. Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints. Physiological Measurement. 2026;47(5):055011. doi:10.1088/1361-6579/ae669e
BibTeX
@article{Latino2026,
author = {Latino, Francesco and Rossi, Matteo and Palmisciano, Andrea Costanzo and Farabbi, Andrea and Krishnan, Athul and Antonello, Niccolò and Mainardi, Luca and Cerveri, Pietro},
title = {Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints},
journal = {Physiological Measurement},
year = {2026},
volume = {47},
number = {5},
pages = {055011},
doi = {10.1088/1361-6579/ae669e}
}
EUVIMED