Distracted Driving Behavior Recognition Based on Improved YOLOv8n-Pose and Multi-Feature Fusion
Applied Sciences · 03.04.2026 · 16 (7) · 3532
DOI: 10.3390/app16073532 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 03.04.2026. Verfasst von Zhuzhou Li und 5 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Research and Development Program of Xinjiang Uygur Autonomous Region, “Research, Development and Demonstration of Expressway Intelligent Operation Integrat…, Open Project of the National Engineering Research Center for Road Traffic Safety Control Technology.
Abstract (Originalsprache)
Distracted driving is one of the primary causes of road traffic accidents. Behavior recognition technology based on machine vision has emerged as a research hotspot due to its non-contact and high-efficiency nature. To address the challenges of complex lighting conditions in the driver’s cabin, low detection accuracy for small-scale keypoints, and the difficulty in effectively characterizing behavioral features, this paper proposes a distracted driving behavior recognition method based on an improved YOLOv8n-Pose model and multi-feature fusion. First, the original YOLOv8n-Pose model is optimized. A P2 detection layer is added to enhance the feature extraction capabilities for small-scale human keypoints, and the SE attention module is incorporated to improve the model’s robustness under complex lighting conditions. In addition, the loss function is replaced with focal loss to tackle the class imbalance problem, thus forming the YOLOv8n-PSF-Pose keypoint detection network. Subsequently, based on the coordinates of 12 human keypoints extracted by this network, a multi-dimensional feature vector is constructed, which takes joint angles as the core and integrates the relative distances between keypoints and the number of valid keypoints. Finally, a BP neural network is adopted to classify the constructed feature vectors, enabling the accurate recognition of six typical distracted driving behaviors (normal driving, drinking or eating, making phone calls, using mobile phones, operating vehicle infotainment systems, and turning around to fetch items). The experimental results show that the improved YOLOv8n-PSF-Pose model achieves an mAP50 of 93.8% in keypoint detection, which is 6.7 percentage points higher than the original model; the BP classification model based on multi-feature fusion achieves an F1-score of 97.7% in the behavior recognition task, which is significantly better than traditional classifiers such as SVM and random forest, and the image processing speed on the NVIDIA RTX 3090TI reaches a high throughput of 45 FPS. This proves that the proposed method achieves an excellent balance between accuracy and speed. This study provides an effective solution for the real-time and accurate recognition of distracted driving behaviors.
Förderung
- Key Research and Development Program of Xinjiang Uygur Autonomous Region, “Research, Development and Demonstration of Expressway Intelligent Operation Integrat…
- Open Project of the National Engineering Research Center for Road Traffic Safety Control Technology
Zitieren
APA
Li, Z., Guo, D., Wei, Z., Chen, G., Sun, M., & Sun, Y. (2026). Distracted Driving Behavior Recognition Based on Improved YOLOv8n-Pose and Multi-Feature Fusion. Applied Sciences, 16(7), 3532. https://doi.org/10.3390/app16073532
Vancouver
Li Z, Guo D, Wei Z, Chen G, Sun M, Sun Y. Distracted Driving Behavior Recognition Based on Improved YOLOv8n-Pose and Multi-Feature Fusion. Applied Sciences. 2026;16(7):3532. doi:10.3390/app16073532
BibTeX
@article{Li2026,
author = {Li, Zhuzhou and Guo, Dudu and Wei, Zhenxun and Chen, Guoliang and Sun, Miao and Sun, Yuhao},
title = {Distracted Driving Behavior Recognition Based on Improved YOLOv8n-Pose and Multi-Feature Fusion},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {7},
pages = {3532},
doi = {10.3390/app16073532}
}
EUVIMED