EUVIMEDEUVIMED entdecken
Crossref

Adaptive Multi-Modal Driver Drowsiness Detection Using Temporal Convolutional Networks

Gurumoorthy P, Karunamurthy A

International Scientific Journal of Engineering and Management · 13.06.2026 · 05 (06) · 1-20

DOI: 10.55041/isjem07785 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Scientific Journal of Engineering and Management, online erschienen am 13.06.2026. Verfasst von Gurumoorthy P und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Driver drowsiness remains a leading cause of road accidents, yet existing detection systems often rely on rigid thresholds applied to isolated physiological signals, resulting in high false positive rates and poor generalization across individuals. We propose a multi-modal adaptive framework that integrates facial landmark detection, eye and mouth aspect ratios, and head pose estimation into a unified temporal model for real-time fatigue scoring. The system first extracts key facial points using a MobileNetV3 backbone with a coordinate regression head, from which geometric ratios such as the Eye Aspect Ratio and Mouth Aspect Ratio are computed. Head pose angles are simultaneously estimated by solving the Perspective-n-Point problem. Instead of applying fixed thresholds to these individual metrics, we feed the continuous feature sequence—including blink frequency derived from the temporal derivative of the Eye Aspect Ratio—into a Temporal Convolutional Network (TCN) with dilated causal convolutions. The TCN captures long-range temporal dependencies that distinguish transient distractions from genuine drowsiness patterns. A fully connected layer with sigmoid activation then outputs a scalar fatigue score between zero and one, representing the probability of a drowsy state. This adaptive score dynamically replaces conventional binary alert logic, allowing the system to respond to complex, multi-variate fatigue signatures such as the simultaneous occurrence of yawning and head nodding. The proposed method reduces false alarms caused by natural facial expressions or environmental factors. Furthermore, the end-to-end learning framework eliminates the need for manual threshold tuning. Experimental results demonstrate that the temporal integration of multiple modalities significantly improves detection accuracy compared to single-metric approaches. The framework is computationally efficient and suitable for real-time deployment in embedded driver monitoring systems. Keywords Driver drowsiness detection · Temporal convolutional network · Facial landmark detection · Eye aspect ratio · Mouth aspect ratio · Head pose estimation · Multimodal learning · Real-time driver monitoring

Zitieren

APA

P, G., & A, K. (2026). Adaptive Multi-Modal Driver Drowsiness Detection Using Temporal Convolutional Networks. International Scientific Journal of Engineering and Management, 05(06), 1-20. https://doi.org/10.55041/isjem07785

Vancouver

P G, A K. Adaptive Multi-Modal Driver Drowsiness Detection Using Temporal Convolutional Networks. International Scientific Journal of Engineering and Management. 2026;05(06):1-20. doi:10.55041/isjem07785

BibTeX
@article{P2026,
  author = {P, Gurumoorthy and A, Karunamurthy},
  title = {Adaptive Multi-Modal Driver Drowsiness Detection Using Temporal Convolutional Networks},
  journal = {International Scientific Journal of Engineering and Management},
  year = {2026},
  volume = {05},
  number = {06},
  pages = {1--20},
  doi = {10.55041/isjem07785}
}
Kostenlos starten →