EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Emotion-Aware Contextual Modelling for Robust Driver Fatigue Detection

Sebastian Budzan iD, Roman Wyżgolik iD

Sensors · 30.06.2026 · 26 (13) · 4120

DOI: 10.3390/s26134120 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 30.06.2026. Verfasst von Sebastian Budzan und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland. Hauptthemen laut MEDLINE: Emotions, Fatigue, Automobile Driving. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Silesian University of Technology.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision-based driver fatigue detection remains challenging because facial signals associated with fatigue are often ambiguous, while geometric indicators such as Eye Aspect Ratio (EAR) and Percentage of Eye Closure (PERCLOS) are prone to false positives caused by normal facial activity, including smiling or speaking. This paper proposes a context-aware framework that integrates behavioural, geometric, and emotional information for robust fatigue assessment. Facial landmarks are extracted using MediaPipe Face Mesh, while adaptive eye-closure detection is performed through multi-stage validation combining EAR trajectories, mouth activity, head-pose analysis, and event-level filtering. Emotion recognition is achieved using an EfficientNet-B0 convolutional neural network trained on the AffectNet dataset, enabling frame-level estimation of facial expression probabilities. These predictions are aggregated into descriptors representing emotional variability and fatigue-related emotional relevance over time. Behavioural information obtained from blinking, yawning, head nodding, and validated PERCLOS is fused with emotional context to construct a multi-level fatigue assessment model. The final Driver Fatigue Risk Index combines physiological eye-closure information with contextual behavioural–emotional analysis, providing an interpretable estimation of driver state rather than a binary classification alone. Experimental evaluation on the NTHU-DDD dataset achieved 94% accuracy and demonstrated improved robustness under non-frontal head poses and expressive facial behaviour.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsFatigueAutomobile DrivingHumansFacial ExpressionConvolutional Neural NetworksAlgorithms

Stichwörter der Autor:innen

behavioural analysisemotion-aware modellingfatigue risk assessmentfatigued driver detectionmultimodal analysis

Autor:innen und Institutionen

  • Department of Measurements and Control Systems, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland.

ORCID-Profile: Sebastian Budzan, Roman Wyżgolik

Förderung

  • Silesian University of Technology

Zitieren

APA

Budzan, S., & Wyżgolik, R. (2026). Emotion-Aware Contextual Modelling for Robust Driver Fatigue Detection. Sensors, 26(13), 4120. https://doi.org/10.3390/s26134120

Vancouver

Budzan S, Wyżgolik R. Emotion-Aware Contextual Modelling for Robust Driver Fatigue Detection. Sensors. 2026;26(13):4120. doi:10.3390/s26134120

BibTeX
@article{Budzan2026,
  author = {Budzan, Sebastian and Wyżgolik, Roman},
  title = {Emotion-Aware Contextual Modelling for Robust Driver Fatigue Detection},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {13},
  pages = {4120},
  doi = {10.3390/s26134120}
}
Kostenlos starten →