Driver Monitoring System Using Computer Vision for Real-Time Detection of Fatigue, Distraction and Emotion via Facial Landmarks and Deep Learning
Sensors · 29.01.2026 · 26 (3) · 889
DOI: 10.3390/s26030889 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 29.01.2026. Verfasst von Tamia Zambrano und 4 weiteren Autor:innen. Beteiligte Einrichtung: Departamento de Automatización y Control Industrial, Escuela Politécnica Nacional, Quito 170525, Ecuador. Hauptthemen laut MEDLINE: Deep Learning, Emotions, Automobile Driving, Fatigue. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Car accidents remain a leading cause of death worldwide, with drowsiness and distraction accounting for roughly 25% of fatal crashes in Ecuador. This study presents a real-time driver monitoring system that uses computer vision and deep learning to detect fatigue, distraction, and emotions from facial expressions. It combines a MobileNetV2-based CNN trained on RAF-DB for emotion recognition and MediaPipe’s 468 facial landmarks to compute the EAR (Eye Aspect Ratio), the MAR (Mouth Aspect Ratio), the gaze, and the head pose. Tests with 27 participants in both real and simulated driving environments showed strong results. There was a 100% accuracy in detecting distraction, 85.19% for yawning, and 88.89% for eye closure. The system also effectively recognized happiness (100%) and anger/disgust (96.3%). However, it struggled with sadness and failed to detect fear, likely due to the subtlety of real-world expressions and limitations in the training dataset. Despite these challenges, the results highlight the importance of integrating emotional awareness into driver monitoring systems, which helps reduce false alarms and improve response accuracy. This work supports the development of lightweight, non-invasive technologies that enhance driving safety through intelligent behavior analysis.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Departamento de Automatización y Control Industrial, Escuela Politécnica Nacional, Quito 170525, Ecuador.
ORCID-Profile: Tamia Zambrano, Luis Arias, Edgar Haro, Victor Santos, María Trujillo-Guerrero
Zitieren
APA
Zambrano, T., Arias, L., Haro, E., Santos, V., & Trujillo-Guerrero, M. (2026). Driver Monitoring System Using Computer Vision for Real-Time Detection of Fatigue, Distraction and Emotion via Facial Landmarks and Deep Learning. Sensors, 26(3), 889. https://doi.org/10.3390/s26030889
Vancouver
Zambrano T, Arias L, Haro E, Santos V, Trujillo-Guerrero M. Driver Monitoring System Using Computer Vision for Real-Time Detection of Fatigue, Distraction and Emotion via Facial Landmarks and Deep Learning. Sensors. 2026;26(3):889. doi:10.3390/s26030889
BibTeX
@article{Zambrano2026,
author = {Zambrano, Tamia and Arias, Luis and Haro, Edgar and Santos, Victor and Trujillo-Guerrero, María},
title = {Driver Monitoring System Using Computer Vision for Real-Time Detection of Fatigue, Distraction and Emotion via Facial Landmarks and Deep Learning},
journal = {Sensors},
year = {2026},
volume = {26},
number = {3},
pages = {889},
doi = {10.3390/s26030889}
}
EUVIMED