Emotion-Aware Contextual Modelling for Robust Driver Fatigue Detection
Sensors · 30.06.2026 · 26 (13) · 4120
DOI: 10.3390/s26134120 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 30.06.2026. Verfasst von Sebastian Budzan und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland. Hauptthemen laut MEDLINE: Emotions, Fatigue, Automobile Driving. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Silesian University of Technology.
Abstract (Originalsprache)
Vision-based driver fatigue detection remains challenging because facial signals associated with fatigue are often ambiguous, while geometric indicators such as Eye Aspect Ratio (EAR) and Percentage of Eye Closure (PERCLOS) are prone to false positives caused by normal facial activity, including smiling or speaking. This paper proposes a context-aware framework that integrates behavioural, geometric, and emotional information for robust fatigue assessment. Facial landmarks are extracted using MediaPipe Face Mesh, while adaptive eye-closure detection is performed through multi-stage validation combining EAR trajectories, mouth activity, head-pose analysis, and event-level filtering. Emotion recognition is achieved using an EfficientNet-B0 convolutional neural network trained on the AffectNet dataset, enabling frame-level estimation of facial expression probabilities. These predictions are aggregated into descriptors representing emotional variability and fatigue-related emotional relevance over time. Behavioural information obtained from blinking, yawning, head nodding, and validated PERCLOS is fused with emotional context to construct a multi-level fatigue assessment model. The final Driver Fatigue Risk Index combines physiological eye-closure information with contextual behavioural–emotional analysis, providing an interpretable estimation of driver state rather than a binary classification alone. Experimental evaluation on the NTHU-DDD dataset achieved 94% accuracy and demonstrated improved robustness under non-frontal head poses and expressive facial behaviour.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland.
ORCID-Profile: Sebastian Budzan, Roman Wyżgolik
Förderung
- Silesian University of Technology
Zitieren
APA
Budzan, S., & Wyżgolik, R. (2026). Emotion-Aware Contextual Modelling for Robust Driver Fatigue Detection. Sensors, 26(13), 4120. https://doi.org/10.3390/s26134120
Vancouver
Budzan S, Wyżgolik R. Emotion-Aware Contextual Modelling for Robust Driver Fatigue Detection. Sensors. 2026;26(13):4120. doi:10.3390/s26134120
BibTeX
@article{Budzan2026,
author = {Budzan, Sebastian and Wyżgolik, Roman},
title = {Emotion-Aware Contextual Modelling for Robust Driver Fatigue Detection},
journal = {Sensors},
year = {2026},
volume = {26},
number = {13},
pages = {4120},
doi = {10.3390/s26134120}
}
EUVIMED