EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dual-Stream Fusion of Eye-Tracking and ECG Signals for Fatigue Detection in Remote Tower Air Traffic Controllers

Dajiang Song iD, Weijun Pan, Hugo Gamboa iD, Zirui Yin iD, Shengjie Wang

Bioengineering · 23.06.2026 · 13 (7) · 717

DOI: 10.3390/bioengineering13070717 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioengineering, online erschienen am 23.06.2026. Verfasst von Dajiang Song und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Sichuan Science and Technology Program, Sichuan Provincial Civil Aviation Flight Technology and Flight Safety Engineering Research Center.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fatigue detection in remote tower air traffic controllers is important for maintaining operational safety under sustained visual monitoring and high cognitive workload. This study proposes MFD-Net, a dual-stream multimodal fusion framework using eye-tracking and electrocardiogram (ECG) signals. The model separately encodes eye-tracking and ECG-derived temporal inputs, incorporates an ECG-derived RMSSD expert feature, and performs lightweight late fusion for fatigue-state classification. Under the mixed-subject random-window protocol, MFD-Net achieved an Accuracy of 85.20%, a Recall of 83.33%, and an AUC of 0.9337. Because overlapping windows from the same participant and scenario could appear in both training and test sets, this result should be interpreted as a potentially optimistic within-distribution estimate. Under the stricter zero-shot leave-one-subject-out (LOSO) protocol, performance decreased substantially, with an Accuracy of 70.95±21.59%, a Recall of 22.98±36.30%, and an AUC of 0.6025±0.2984. This low zero-shot Recall indicates limited subject-independent fatigue-detection capability. Lightweight target-subject calibration and sequential probability aggregation improved adaptation and temporal stability, although the calibration results should be interpreted cautiously because random target-subject windows were used for fine-tuning. These findings suggest that eye-tracking and ECG fusion are promising under controlled conditions, while practical deployment requires deployment-oriented calibration protocols, recall-oriented optimization, and further real-world validation.

Schlagwörter

Stichwörter der Autor:innen

air traffic controllerscross-subject calibrationdeep learningelectrocardiogrameye trackingfatigue detectionheart rate variabilityphysiological signal fusion

Autor:innen und Institutionen

  • Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China.
  • LIBPhys (Laboratory for Instrumentation, Biomedical Engineering and Radiation Physics), Department of Physics, NOVA School of Science and Technology, NOVA University Lisbon, Largo da Torre, 2829-516 Caparica, Portugal.
  • School of Transportation and Logistics, Southwest Jiaotong University, Chengdu 611756, China.

ORCID-Profile: Dajiang Song, Hugo Gamboa, Zirui Yin

Förderung

  • National Natural Science Foundation of China
  • Sichuan Science and Technology Program
  • Sichuan Provincial Civil Aviation Flight Technology and Flight Safety Engineering Research Center
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Song, D., Pan, W., Gamboa, H., Yin, Z., & Wang, S. (2026). Dual-Stream Fusion of Eye-Tracking and ECG Signals for Fatigue Detection in Remote Tower Air Traffic Controllers. Bioengineering, 13(7), 717. https://doi.org/10.3390/bioengineering13070717

Vancouver

Song D, Pan W, Gamboa H, Yin Z, Wang S. Dual-Stream Fusion of Eye-Tracking and ECG Signals for Fatigue Detection in Remote Tower Air Traffic Controllers. Bioengineering. 2026;13(7):717. doi:10.3390/bioengineering13070717

BibTeX
@article{Song2026,
  author = {Song, Dajiang and Pan, Weijun and Gamboa, Hugo and Yin, Zirui and Wang, Shengjie},
  title = {Dual-Stream Fusion of Eye-Tracking and ECG Signals for Fatigue Detection in Remote Tower Air Traffic Controllers},
  journal = {Bioengineering},
  year = {2026},
  volume = {13},
  number = {7},
  pages = {717},
  doi = {10.3390/bioengineering13070717}
}
Kostenlos starten →