EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal EEG and Eye-Tracking Assessment of Perceived Mental Workload and Situation Awareness in a Visual Display Terminal Simulation Task

Mingchong Xiao, Zhengwen Zhou iD, Han Peng, Zhe Lin, Yibo Yang, Jialong Chen, Liangjie Guo iD

Sensors · 31.07.2026 · 26 (15) · 4835

DOI: 10.3390/s26154835 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 31.07.2026. Verfasst von Mingchong Xiao und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation Science and Engineering, South China University of Technology, Guangzhou 510641, China. Hauptthemen laut MEDLINE: Electroencephalography, Awareness, Workload, Eye-Tracking Technology. Die Arbeit nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Production Safety Special Fund Science and Technology Project of Hubei Province, the Open Fund of China University of Geosciences (Wuhan) Laboratory, Production Safety Special Fund Science and Technology Project of Hubei Province.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual display terminal (VDT) tasks are common in safety-critical systems, where operators must continuously monitor dynamic information and maintain situation awareness (SA). This study examined whether EEG and eye-tracking technologies could support the assessment of SA and perceived mental workload in VDT tasks. Short-term incentive conditions were included only as an exploratory contextual factor. Thirty participants completed a SATEST-based VDT simulation task while subjective scales, behavioral performance, EEG signals, and eye-tracking data were collected during the perception, comprehension, and projection stages of SA. Physiological indicators associated with SA differences and workload-related patterns were examined using SART-based and NASA-TLX-based grouping, supplemented by continuous-score Spearman correlation and exploratory linear regression analyses. The incentive analysis was exploratory, underpowered for small-to-medium effects, and was not designed to validate an incentive-based cognitive-state regulation strategy. Saccade-related eye-tracking indicators differed between relatively higher-SA and lower-SA groups across several stages (p = 0.0043 to 0.0457, Cohen’s d = −0.670 to −1.002), while fronto-central relative theta power showed an SA-related difference during the SA1 perception stage (p = 0.0315, Cohen’s d = −0.746). Relatively higher perceived workload was associated with lower SART scores (p = 0.0187), lower SA2 accuracy (p = 0.0175), larger SA3 angular error (p = 0.0151), and lower frontal theta-band and alpha-band absolute power across selected stages (p = 0.0094 to 0.0294). The exploratory incentive analysis showed only a limited stage-specific difference in SA1 distance error, with no reliable differences in overall SART score, SA2 accuracy, SA3 angular error, or NASA-TLX score. Thus, the findings provide insufficient evidence that the present short-term incentive manipulation produced reliable cognitive-state regulation. Overall, these findings provide preliminary support for multimodal physiological assessment in VDT tasks and suggest that the identified physiological measures should be regarded as candidate indicators requiring further validation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ElectroencephalographyAwarenessWorkloadEye-Tracking TechnologyHumansFemaleMaleAdultYoung AdultTask Performance and AnalysisEye Movements

Stichwörter der Autor:innen

EEGeye-trackingneuroergonomicsperceived mental workloadsituation awarenessvisual display terminal

Autor:innen und Institutionen

  • School of Automation Science and Engineering, South China University of Technology, Guangzhou 510641, China.
  • Faculty of Engineering, China University of Geosciences (Wuhan), Wuhan 430074, China.
  • Yangtze Optical Fiber and Cable Joint Stock Limited Company, Wuhan 430073, China.

ORCID-Profile: Zhengwen Zhou, Liangjie Guo

Förderung

  • the Production Safety Special Fund Science and Technology Project of Hubei Province
  • the Open Fund of China University of Geosciences (Wuhan) Laboratory
  • Production Safety Special Fund Science and Technology Project of Hubei Province
  • Open Fund of the Laboratory, China University of Geosciences

Zitieren

APA

Xiao, M., Zhou, Z., Peng, H., Lin, Z., Yang, Y., Chen, J., & Guo, L. (2026). Multimodal EEG and Eye-Tracking Assessment of Perceived Mental Workload and Situation Awareness in a Visual Display Terminal Simulation Task. Sensors, 26(15), 4835. https://doi.org/10.3390/s26154835

Vancouver

Xiao M, Zhou Z, Peng H, Lin Z, Yang Y, Chen J, et al. Multimodal EEG and Eye-Tracking Assessment of Perceived Mental Workload and Situation Awareness in a Visual Display Terminal Simulation Task. Sensors. 2026;26(15):4835. doi:10.3390/s26154835

BibTeX
@article{Xiao2026,
  author = {Xiao, Mingchong and Zhou, Zhengwen and Peng, Han and Lin, Zhe and Yang, Yibo and Chen, Jialong and Guo, Liangjie},
  title = {Multimodal EEG and Eye-Tracking Assessment of Perceived Mental Workload and Situation Awareness in a Visual Display Terminal Simulation Task},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {15},
  pages = {4835},
  doi = {10.3390/s26154835}
}
Kostenlos starten →