EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Driver Monitoring System Using Computer Vision for Real-Time Detection of Fatigue, Distraction and Emotion via Facial Landmarks and Deep Learning

Tamia Zambrano iD, Luis Arias iD, Edgar Haro iD, Victor Santos iD, María Trujillo-Guerrero iD

Sensors · 29.01.2026 · 26 (3) · 889

DOI: 10.3390/s26030889 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 29.01.2026. Verfasst von Tamia Zambrano und 4 weiteren Autor:innen. Beteiligte Einrichtung: Departamento de Automatización y Control Industrial, Escuela Politécnica Nacional, Quito 170525, Ecuador. Hauptthemen laut MEDLINE: Deep Learning, Emotions, Automobile Driving, Fatigue. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Car accidents remain a leading cause of death worldwide, with drowsiness and distraction accounting for roughly 25% of fatal crashes in Ecuador. This study presents a real-time driver monitoring system that uses computer vision and deep learning to detect fatigue, distraction, and emotions from facial expressions. It combines a MobileNetV2-based CNN trained on RAF-DB for emotion recognition and MediaPipe’s 468 facial landmarks to compute the EAR (Eye Aspect Ratio), the MAR (Mouth Aspect Ratio), the gaze, and the head pose. Tests with 27 participants in both real and simulated driving environments showed strong results. There was a 100% accuracy in detecting distraction, 85.19% for yawning, and 88.89% for eye closure. The system also effectively recognized happiness (100%) and anger/disgust (96.3%). However, it struggled with sadness and failed to detect fear, likely due to the subtlety of real-world expressions and limitations in the training dataset. Despite these challenges, the results highlight the importance of integrating emotional awareness into driver monitoring systems, which helps reduce false alarms and improve response accuracy. This work supports the development of lightweight, non-invasive technologies that enhance driving safety through intelligent behavior analysis.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningEmotionsAutomobile DrivingFatigueHumansFacial ExpressionConvolutional Neural NetworksAccidents, Traffic

Stichwörter der Autor:innen

Eye Aspect Ratio (EAR)Mouth Aspect Ratio (MAR)deep learningdistraction detectiondriver monitoring systemdrowsiness detectionemotion recognition

Autor:innen und Institutionen

  • Departamento de Automatización y Control Industrial, Escuela Politécnica Nacional, Quito 170525, Ecuador.

ORCID-Profile: Tamia Zambrano, Luis Arias, Edgar Haro, Victor Santos, María Trujillo-Guerrero

Zitieren

APA

Zambrano, T., Arias, L., Haro, E., Santos, V., & Trujillo-Guerrero, M. (2026). Driver Monitoring System Using Computer Vision for Real-Time Detection of Fatigue, Distraction and Emotion via Facial Landmarks and Deep Learning. Sensors, 26(3), 889. https://doi.org/10.3390/s26030889

Vancouver

Zambrano T, Arias L, Haro E, Santos V, Trujillo-Guerrero M. Driver Monitoring System Using Computer Vision for Real-Time Detection of Fatigue, Distraction and Emotion via Facial Landmarks and Deep Learning. Sensors. 2026;26(3):889. doi:10.3390/s26030889

BibTeX
@article{Zambrano2026,
  author = {Zambrano, Tamia and Arias, Luis and Haro, Edgar and Santos, Victor and Trujillo-Guerrero, María},
  title = {Driver Monitoring System Using Computer Vision for Real-Time Detection of Fatigue, Distraction and Emotion via Facial Landmarks and Deep Learning},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {3},
  pages = {889},
  doi = {10.3390/s26030889}
}
Kostenlos starten →