A Multi-Source Fusion Approach for Driver Fatigue Detection Using Physiological Signals and Facial Image
IEEE Transactions on Intelligent Transportation Systems · 2024-11 · 25 (11) · 16614-16624
DOI: 10.1109/tits.2024.3420409 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-11. Verfasst von Yong Peng und 6 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: National Key Research and Development Program of China, Science and Technology Innovation Leaders of Hunan Province, National Natural Science Foundation of China.
Abstract (Originalsprache)
Detecting driver fatigue is critical to ensuring road safety. Existing fatigue detection methods typically rely on traditional hand-picked features as inputs. However, these hand-picked features can hardly respond accurately to the driver’s fatigue state due to a certain degree of subjectivity and the extraction of these features requires a long time window, which limits the accuracy and real-time performance of the detection. This paper proposes a novel fatigue detection method based on multi-source information fusion, which relies entirely on neural networks for automatic feature extraction. Through simulated driving experiments, we recorded physiological signals and facial videos from 21 participants for model training and testing. The results show that our model outperforms existing methods in terms of accuracy and real-time performance, achieving a detection accuracy of 93.15% within a 3-second time window (specificity = 94.04%, sensitivity = 91.71%). The visualization results of the model reveal potential relationships between facial regions for the first time, validating the rationality and effectiveness of our method. The practical issues of fatigue detection methods and future research directions are also explored.
Förderung
- National Key Research and Development Program of China
- Science and Technology Innovation Leaders of Hunan Province
- National Natural Science Foundation of China
- Post-Graduate Scientific Research Innovation Project of Central South University
Zitieren
APA
Peng, Y., Deng, H., Xiang, G., Wu, X., Yu, X., Li, Y., & Yu, T. (2024). A Multi-Source Fusion Approach for Driver Fatigue Detection Using Physiological Signals and Facial Image. IEEE Transactions on Intelligent Transportation Systems, 25(11), 16614-16624. https://doi.org/10.1109/tits.2024.3420409
Vancouver
Peng Y, Deng H, Xiang G, Wu X, Yu X, Li Y, et al. A Multi-Source Fusion Approach for Driver Fatigue Detection Using Physiological Signals and Facial Image. IEEE Transactions on Intelligent Transportation Systems. 2024;25(11):16614-16624. doi:10.1109/tits.2024.3420409
BibTeX
@article{Peng2024,
author = {Peng, Yong and Deng, Hanwen and Xiang, Guoliang and Wu, Xianhui and Yu, Xizhuo and Li, Yingli and Yu, Tianjian},
title = {A Multi-Source Fusion Approach for Driver Fatigue Detection Using Physiological Signals and Facial Image},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2024},
volume = {25},
number = {11},
pages = {16614--16624},
doi = {10.1109/tits.2024.3420409}
}
EUVIMED