EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints

Francesco Latino iD, Matteo Rossi iD, Andrea Costanzo Palmisciano iD, Andrea Farabbi iD, Athul Krishnan iD, Niccolò Antonello iD, Luca Mainardi iD, Pietro Cerveri iD

Physiological Measurement · 29.05.2026 · 47 (5) · 055011

DOI: 10.1088/1361-6579/ae669e ↗

Kurz gefasst

Fachartikel in der Zeitschrift Physiological Measurement, online erschienen am 12.05.2026. Verfasst von Francesco Latino und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy. Hauptthemen laut MEDLINE: Facial Expression, Electric Capacitance, Wearable Electronic Devices, Eyeglasses. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective. Wearable facial expression recognition requires sensing modalities that are unobtrusive, illumination-independent, and compatible with everyday eyewear form factors. Existing optical and electromyographic approaches are limited by line-of-sight requirements, skin contact, or restricted action unit (AU) coverage. This work investigates the feasibility of non-contact capacitive sensing for facial muscle activity monitoring within the strict geometric constraints of standard eyewear. Approach. We developed FERGlasses, integrating eight loading-mode capacitive channels via a custom flexible PCB and active shielding to detect skin-to-frame displacement. A validation study with 40 participants was conducted to elicit seven facial action coding system-defined AUs. Signal fidelity was assessed using independent Random Forest regressors and benchmarked against commercial optical-proximity (OCOsense) and computer-vision (Py-Feat) standards. Main results. The system demonstrated high agreement for upper-face activity, achieving median cosine similarities of 0.97 for the Outer Brow Raiser (AU02) and 0.87 for the Nose Wrinkler (AU09), while lower-face actions such as the Chin Raiser (AU17) yielded a median of 0.33, consistent with mechanical signal attenuation along the frame. Channel-ablation analysis quantified the specific anatomical contributions of each electrode group, identifying eyebrow and rhinion sensors as primary signal drivers for upper-face and perinasal actions, respectively, and temple sensors as critical for cheek raiser detection. Significance. This study provides the first metrological validation of multi-channel capacitive sensing for AU-level recognition in eyewear. The results establish the modality as a robust, privacy-preserving, and illumination-independent alternative to optical methods for longitudinal physiological monitoring, with the current prototype serving as a wired research platform and full consumer-grade integration identified as a future engineering objective.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial ExpressionElectric CapacitanceWearable Electronic DevicesEyeglassesHumansFemaleMaleSignal Processing, Computer-Assisted

Stichwörter der Autor:innen

action unitcapacitive sensorseyewear systemsfacial expression recognition

Autor:innen und Institutionen

  • Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy.
  • Smart Eyewear Laboratory, EssilorLuxottica, Milan, Italy.
  • Department of Industrial and Information Engineering, Università di Pavia, Pave, Italy.

ORCID-Profile: Francesco Latino, Matteo Rossi, Andrea Costanzo Palmisciano, Andrea Farabbi, Athul Krishnan, Niccolò Antonello, Luca Mainardi, Pietro Cerveri

Zitieren

APA

Latino, F., Rossi, M., Palmisciano, A. C., Farabbi, A., Krishnan, A., Antonello, N., Mainardi, L., & Cerveri, P. (2026). Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints. Physiological Measurement, 47(5), 055011. https://doi.org/10.1088/1361-6579/ae669e

Vancouver

Latino F, Rossi M, Palmisciano AC, Farabbi A, Krishnan A, Antonello N, et al. Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints. Physiological Measurement. 2026;47(5):055011. doi:10.1088/1361-6579/ae669e

BibTeX
@article{Latino2026,
  author = {Latino, Francesco and Rossi, Matteo and Palmisciano, Andrea Costanzo and Farabbi, Andrea and Krishnan, Athul and Antonello, Niccolò and Mainardi, Luca and Cerveri, Pietro},
  title = {Turning glasses into sensors: capacitive facial expression recognition under frame geometry constraints},
  journal = {Physiological Measurement},
  year = {2026},
  volume = {47},
  number = {5},
  pages = {055011},
  doi = {10.1088/1361-6579/ae669e}
}
Kostenlos starten →