EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TriViT-Lite: A Compact Vision Transformer–MobileNet Model with Texture-Aware Attention for Real-Time Facial Emotion Recognition in Healthcare

Waqar Riaz, Jiancheng (Charles) Ji, Asif Ullah

Electronics · 16.08.2025 · 14 (16) · 3256

DOI: 10.3390/electronics14163256 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 16.08.2025. Verfasst von Waqar Riaz und 2 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: school-level project of SZPU Grants, Post-doctoral Later-stage Foundation Project of Shenzhen Polytechnic University, Shenzhen Polytechnic University Scientific Research Start-up Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial emotion recognition has become increasingly important in healthcare, where understanding delicate cues like pain, discomfort, or unconsciousness can support more timely and responsive care. Yet, recognizing facial expressions in real-world settings remains challenging due to varying lighting, facial occlusions, and hardware limitations in clinical environments. To address this, we propose TriViT-Lite, a lightweight yet powerful model that blends three complementary components: MobileNet, for capturing fine-grained local features efficiently; Vision Transformers (ViT), for modeling global facial patterns; and handcrafted texture descriptors, such as Local Binary Patterns (LBP) and Histograms of Oriented Gradients (HOG), for added robustness. These multi-scale features are brought together through a texture-aware cross-attention fusion mechanism that helps the model focus on the most relevant facial regions dynamically. TriViT-Lite is evaluated on both benchmark datasets (FER2013, AffectNet) and a custom healthcare-oriented dataset covering seven critical emotional states, including pain and unconsciousness. It achieves a competitive accuracy of 91.8% on FER2013 and of 87.5% on the custom dataset while maintaining real-time performance (~15 FPS) on resource-constrained edge devices. Our results show that TriViT-Lite offers a practical and accurate solution for real-time emotion recognition, particularly in healthcare settings. It strikes a balance between performance, interpretability, and efficiency, making it a strong candidate for machine-learning-driven pattern recognition in patient-monitoring applications.

Förderung

  • school-level project of SZPU Grants
  • Post-doctoral Later-stage Foundation Project of Shenzhen Polytechnic University
  • Shenzhen Polytechnic University Scientific Research Start-up Project
  • Post-doctoral Foundation Project of Shenzhen Polytechnic University

Zitieren

APA

Riaz, W., Ji, J. C., & Ullah, A. (2025). TriViT-Lite: A Compact Vision Transformer–MobileNet Model with Texture-Aware Attention for Real-Time Facial Emotion Recognition in Healthcare. Electronics, 14(16), 3256. https://doi.org/10.3390/electronics14163256

Vancouver

Riaz W, Ji JC, Ullah A. TriViT-Lite: A Compact Vision Transformer–MobileNet Model with Texture-Aware Attention for Real-Time Facial Emotion Recognition in Healthcare. Electronics. 2025;14(16):3256. doi:10.3390/electronics14163256

BibTeX
@article{Riaz2025,
  author = {Riaz, Waqar and Ji, Jiancheng (Charles) and Ullah, Asif},
  title = {TriViT-Lite: A Compact Vision Transformer–MobileNet Model with Texture-Aware Attention for Real-Time Facial Emotion Recognition in Healthcare},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {16},
  pages = {3256},
  doi = {10.3390/electronics14163256}
}
Kostenlos starten →