EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TMU-Net: A Transformer-Based Multimodal Framework with Uncertainty Quantification for Driver Fatigue Detection

Yaxin Zhang, Xuegang Xu, Yuetao Du, Ningchao Zhang

Sensors · 29.08.2025 · 25 (17) · 5364

DOI: 10.3390/s25175364 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 29.08.2025. Verfasst von Yaxin Zhang und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Electronic Information Engineering, Xi'an Technological University, Xi'an 710021, China. Hauptthemen laut MEDLINE: Fatigue, Automobile Driving. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Driving fatigued is a prevalent issue frequently contributing to traffic accidents, prompting the development of automated fatigue detection methods based on various data sources, particularly reliable physiological signals. However, challenges in accuracy, robustness, and practicality persist, especially for cross-subject detection. Multimodal data fusion can enhance the effective estimation of driver fatigue. In this work, we leverage the advantages of multimodal signals to propose a novel Multimodal Attention Network (TMU-Net) for driver fatigue detection, achieving precise fatigue assessment by integrating electroencephalogram (EEG) and electrooculogram (EOG) signals. The core innovation of TMU-Net lies in its unimodal feature extraction module, which combines causal convolution, ConvSparseAttention, and Transformer encoders to effectively capture spatiotemporal features, and a multimodal fusion module that employs cross-modal attention and uncertainty-weighted gating to dynamically integrate complementary information. By incorporating uncertainty quantification, TMU-Net significantly enhances robustness to noise and individual variability. Experimental validation on the SEED-VIG dataset demonstrates TMU-Net’s superior performance stability across 23 subjects in cross-subject testing, effectively leveraging the complementary strengths of EEG (2 Hz full-band and five-band features) and EOG signals for high-precision fatigue detection. Furthermore, attention heatmap visualization reveals the dynamic interaction mechanisms between EEG and EOG signals, confirming the physiological rationality of TMU-Net’s feature fusion strategy. Practical challenges and future research directions for fatigue detection methods are also discussed.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FatigueAutomobile DrivingHumansElectroencephalographyElectrooculographyUncertaintyAdultAttentionSignal Processing, Computer-AssistedAlgorithmsMaleNeural Networks, Computer

Stichwörter der Autor:innen

driver fatigue detectionelectroencephalogram (EEG)electrooculogram (EOG)multimodal fusionuncertainty quantification

Autor:innen und Institutionen

  • School of Electronic Information Engineering, Xi'an Technological University, Xi'an 710021, China.

Zitieren

APA

Zhang, Y., Xu, X., Du, Y., & Zhang, N. (2025). TMU-Net: A Transformer-Based Multimodal Framework with Uncertainty Quantification for Driver Fatigue Detection. Sensors, 25(17), 5364. https://doi.org/10.3390/s25175364

Vancouver

Zhang Y, Xu X, Du Y, Zhang N. TMU-Net: A Transformer-Based Multimodal Framework with Uncertainty Quantification for Driver Fatigue Detection. Sensors. 2025;25(17):5364. doi:10.3390/s25175364

BibTeX
@article{Zhang2025,
  author = {Zhang, Yaxin and Xu, Xuegang and Du, Yuetao and Zhang, Ningchao},
  title = {TMU-Net: A Transformer-Based Multimodal Framework with Uncertainty Quantification for Driver Fatigue Detection},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {17},
  pages = {5364},
  doi = {10.3390/s25175364}
}
Kostenlos starten →