Adaptive Multi-Temporal Fusion and Cross-Modal Adversarial Alignment for Robust Driver Fatigue Detection
Sensors · 06.07.2026 · 26 (13) · 4298
DOI: 10.3390/s26134298 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 06.07.2026. Verfasst von Yanqiao Feng und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Traffic and Transportation, Chongqing Jiaotong University, Chongqing 400074, China. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Sichuan Provincial Department of Transportation.
Abstract (Originalsprache)
To address the critical challenges of multi-scale temporal dynamics and sensor-intrusiveness in driver fatigue detection, this paper proposes the Multi-Temporal Fusion Attention Network (MTFA-Net). The framework integrates two core innovations: a Multi-scale Temporal Adaptive Fusion (MTAF) module that dynamically weights short-, mid-, and long-term behavioral features via a scene-aware modulator, and a Physiological–Behavioral Cross-modal Adversarial Alignment (PBCAA) network that implicitly infers latent physiological states (e.g., HRV) from facial videos using adversarial learning and mutual information maximization. Experimental results on RLDD and NTHU-DDD datasets demonstrate that MTFA-Net achieves state-of-the-art accuracy (92.8%) while maintaining high interpretability and real-time efficiency, providing a robust, non-intrusive solution for intelligent cockpit safety.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Traffic and Transportation, Chongqing Jiaotong University, Chongqing 400074, China.
- Department of Traffic and Transportation & Economics and Management, Sichuan Jiaotong Polytechnic University, Chengdu 611130, China.
- School of Business, Stockton University, Galloway, NJ 08205, USA.
ORCID-Profile: Yanqiao Feng, Yong Peng, Dennis Z Yu
Förderung
- Sichuan Provincial Department of Transportation
Zitieren
APA
Feng, Y., Peng, Y., & Yu, D. Z. (2026). Adaptive Multi-Temporal Fusion and Cross-Modal Adversarial Alignment for Robust Driver Fatigue Detection. Sensors, 26(13), 4298. https://doi.org/10.3390/s26134298
Vancouver
Feng Y, Peng Y, Yu DZ. Adaptive Multi-Temporal Fusion and Cross-Modal Adversarial Alignment for Robust Driver Fatigue Detection. Sensors. 2026;26(13):4298. doi:10.3390/s26134298
BibTeX
@article{Feng2026,
author = {Feng, Yanqiao and Peng, Yong and Yu, Dennis Z},
title = {Adaptive Multi-Temporal Fusion and Cross-Modal Adversarial Alignment for Robust Driver Fatigue Detection},
journal = {Sensors},
year = {2026},
volume = {26},
number = {13},
pages = {4298},
doi = {10.3390/s26134298}
}
EUVIMED