EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Real-Time Embedded System for Driver Drowsiness Detection Based on Visual Analysis of the Eyes and Mouth Using Convolutional Neural Network and Mouth Aspect Ratio

Ruben Florez iD, Facundo Palomino-Quispe iD, Ana Beatriz Alvarez iD, Roger Jesus Coaquira-Castillo iD, Julio Cesar Herrera-Levano iD

Sensors · 27.09.2024 · 24 (19) · 6261

DOI: 10.3390/s24196261 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 27.09.2024. Verfasst von Ruben Florez und 4 weiteren Autor:innen. Beteiligte Einrichtung: LIECAR Laboratory, Universidad Nacional de San Antonio Abad del Cusco (UNSAAC), Cusco 08003, Peru. Hauptthemen laut MEDLINE: Neural Networks, Computer, Automobile Driving. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Currently, the number of vehicles in circulation continues to increase steadily, leading to a parallel increase in vehicular accidents. Among the many causes of these accidents, human factors such as driver drowsiness play a fundamental role. In this context, one solution to address the challenge of drowsiness detection is to anticipate drowsiness by alerting drivers in a timely and effective manner. Thus, this paper presents a Convolutional Neural Network (CNN)-based approach for drowsiness detection by analyzing the eye region and Mouth Aspect Ratio (MAR) for yawning detection. As part of this approach, endpoint delineation is optimized for extraction of the region of interest (ROI) around the eyes. An NVIDIA Jetson Nano-based device and near-infrared (NIR) camera are used for real-time applications. A Driver Drowsiness Artificial Intelligence (DD-AI) architecture is proposed for the eye state detection procedure. In a performance analysis, the results of the proposed approach were compared with architectures based on InceptionV3, VGG16, and ResNet50V2. Night-Time Yawning–Microsleep–Eyeblink–Driver Distraction (NITYMED) was used for training, validation, and testing of the architectures. The proposed DD-AI network achieved an accuracy of 99.88% with the NITYMED test data, proving superior to the other networks. In the hardware implementation, tests were conducted in a real environment, resulting in 96.55% and 14 fps on average for the DD-AI network, thereby confirming its superior performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerAutomobile DrivingHumansMouthEyeSleep StagesSleepinessArtificial IntelligenceAccidents, Traffic

Stichwörter der Autor:innen

NVIDIA Jetson Nanoconvolutional neural network (CNN)driver monitoring systemdrowsiness detectionmouth aspect ratio (MAR)yawning detection

Autor:innen und Institutionen

  • LIECAR Laboratory, Universidad Nacional de San Antonio Abad del Cusco (UNSAAC), Cusco 08003, Peru.
  • PAVIC Laboratory, University of Acre (UFAC), Rio Branco 69915-900, Brazil.

ORCID-Profile: Ruben Florez, Facundo Palomino-Quispe, Ana Beatriz Alvarez, Roger Jesus Coaquira-Castillo, Julio Cesar Herrera-Levano

Zitieren

APA

Florez, R., Palomino-Quispe, F., Alvarez, A. B., Coaquira-Castillo, R. J., & Herrera-Levano, J. C. (2024). A Real-Time Embedded System for Driver Drowsiness Detection Based on Visual Analysis of the Eyes and Mouth Using Convolutional Neural Network and Mouth Aspect Ratio. Sensors, 24(19), 6261. https://doi.org/10.3390/s24196261

Vancouver

Florez R, Palomino-Quispe F, Alvarez AB, Coaquira-Castillo RJ, Herrera-Levano JC. A Real-Time Embedded System for Driver Drowsiness Detection Based on Visual Analysis of the Eyes and Mouth Using Convolutional Neural Network and Mouth Aspect Ratio. Sensors. 2024;24(19):6261. doi:10.3390/s24196261

BibTeX
@article{Florez2024,
  author = {Florez, Ruben and Palomino-Quispe, Facundo and Alvarez, Ana Beatriz and Coaquira-Castillo, Roger Jesus and Herrera-Levano, Julio Cesar},
  title = {A Real-Time Embedded System for Driver Drowsiness Detection Based on Visual Analysis of the Eyes and Mouth Using Convolutional Neural Network and Mouth Aspect Ratio},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {19},
  pages = {6261},
  doi = {10.3390/s24196261}
}
Kostenlos starten →