EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Lightweight Vision-Based Emotion Sensing Framework for Assistive Healthcare Robotics

Hosam Zolfonoon iD, Helder Jesus Araújo iD, Lino Marques iD

Sensors · 03.05.2026 · 26 (9) · 2865

DOI: 10.3390/s26092865 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 03.05.2026. Verfasst von Hosam Zolfonoon und 2 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Systems and Robotics, University of Coimbra, 3030-290 Coimbra, Portugal. Hauptthemen laut MEDLINE: Robotics, Emotions. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Recovery and Resilience Plan.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition (FER) for assistive and telepresence robotics remains challenging under resource-constrained conditions because landmark normalization is often unstable, many datasets have limited variability, and full facial landmark sets introduce redundancy. This paper proposes a lightweight, privacy-preserving FER framework for assistive healthcare robotics based on geometric facial landmarks rather than raw RGB images. The objective is to improve recognition robustness and deployment suitability on low-power edge devices through two complementary contributions: a revised nose-centered landmark normalization method and an optimized Facial Feature Mapping, FFM-L03. The proposed normalization replaces the expression-sensitive upper-lip reference with a geometrically stable nose-center anchor, while FFM-L03 combines FACS-guided anatomical priors with ANOVA F-score, LASSO, PCA, and t-SNE/UMAP to retain 60 informative landmarks. In addition, a heterogeneous Freepik dataset was constructed to increase variability in lighting, background, resolution, and subject appearance. Experimental evaluation across 15 landmark groups, four datasets, and four classifiers shows that the proposed method consistently improves performance over prior landmark configurations, achieving gains of up to 22.4 percentage points over the Ciraolo baseline and 22.1 percentage points over the full-landmark baseline in accuracy, precision, recall, and F1-score, while maintaining lightweight operation. These results demonstrate that principled normalization and targeted landmark selection can substantially improve FER for real-time, privacy-aware assistive robotic systems.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RoboticsEmotionsHumansFacial ExpressionAlgorithmsPattern Recognition, AutomatedFaceImage Processing, Computer-Assisted

Stichwörter der Autor:innen

MediaPipefacial expression recognition (FER)facial feature mapping (FFM)facial landmark normalizationmachine learningtelepresence robots in elderly care

Autor:innen und Institutionen

  • Institute of Systems and Robotics, University of Coimbra, 3030-290 Coimbra, Portugal.

ORCID-Profile: Hosam Zolfonoon, Helder Jesus Araújo, Lino Marques

Förderung

  • Recovery and Resilience Plan

Zitieren

APA

Zolfonoon, H., Araújo, H. J., & Marques, L. (2026). A Lightweight Vision-Based Emotion Sensing Framework for Assistive Healthcare Robotics. Sensors, 26(9), 2865. https://doi.org/10.3390/s26092865

Vancouver

Zolfonoon H, Araújo HJ, Marques L. A Lightweight Vision-Based Emotion Sensing Framework for Assistive Healthcare Robotics. Sensors. 2026;26(9):2865. doi:10.3390/s26092865

BibTeX
@article{Zolfonoon2026,
  author = {Zolfonoon, Hosam and Araújo, Helder Jesus and Marques, Lino},
  title = {A Lightweight Vision-Based Emotion Sensing Framework for Assistive Healthcare Robotics},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {9},
  pages = {2865},
  doi = {10.3390/s26092865}
}
Kostenlos starten →