EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Adaptive Multi-Temporal Fusion and Cross-Modal Adversarial Alignment for Robust Driver Fatigue Detection

Yanqiao Feng iD, Yong Peng iD, Dennis Z Yu iD

Sensors · 06.07.2026 · 26 (13) · 4298

DOI: 10.3390/s26134298 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 06.07.2026. Verfasst von Yanqiao Feng und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Traffic and Transportation, Chongqing Jiaotong University, Chongqing 400074, China. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Sichuan Provincial Department of Transportation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To address the critical challenges of multi-scale temporal dynamics and sensor-intrusiveness in driver fatigue detection, this paper proposes the Multi-Temporal Fusion Attention Network (MTFA-Net). The framework integrates two core innovations: a Multi-scale Temporal Adaptive Fusion (MTAF) module that dynamically weights short-, mid-, and long-term behavioral features via a scene-aware modulator, and a Physiological–Behavioral Cross-modal Adversarial Alignment (PBCAA) network that implicitly infers latent physiological states (e.g., HRV) from facial videos using adversarial learning and mutual information maximization. Experimental results on RLDD and NTHU-DDD datasets demonstrate that MTFA-Net achieves state-of-the-art accuracy (92.8%) while maintaining high interpretability and real-time efficiency, providing a robust, non-intrusive solution for intelligent cockpit safety.

Schlagwörter

Stichwörter der Autor:innen

adversarial alignmentcross-modal learningdriver drowsiness detectionintelligent cockpit safetymulti-temporal fusion

Autor:innen und Institutionen

  • School of Traffic and Transportation, Chongqing Jiaotong University, Chongqing 400074, China.
  • Department of Traffic and Transportation & Economics and Management, Sichuan Jiaotong Polytechnic University, Chengdu 611130‌, China.
  • School of Business, Stockton University, Galloway, NJ 08205, USA.

ORCID-Profile: Yanqiao Feng, Yong Peng, Dennis Z Yu

Förderung

  • Sichuan Provincial Department of Transportation

Zitieren

APA

Feng, Y., Peng, Y., & Yu, D. Z. (2026). Adaptive Multi-Temporal Fusion and Cross-Modal Adversarial Alignment for Robust Driver Fatigue Detection. Sensors, 26(13), 4298. https://doi.org/10.3390/s26134298

Vancouver

Feng Y, Peng Y, Yu DZ. Adaptive Multi-Temporal Fusion and Cross-Modal Adversarial Alignment for Robust Driver Fatigue Detection. Sensors. 2026;26(13):4298. doi:10.3390/s26134298

BibTeX
@article{Feng2026,
  author = {Feng, Yanqiao and Peng, Yong and Yu, Dennis Z},
  title = {Adaptive Multi-Temporal Fusion and Cross-Modal Adversarial Alignment for Robust Driver Fatigue Detection},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {13},
  pages = {4298},
  doi = {10.3390/s26134298}
}
Kostenlos starten →