EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Driving-Related Cognitive Abilities Prediction Based on Transformer’s Multimodal Fusion Framework

Yifan Li, Bo Liu, Wenli Zhang iD

Sensors · 31.12.2024 · 25 (1) · 174

DOI: 10.3390/s25010174 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 31.12.2024. Verfasst von Yifan Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Information Science and Technology, Beijing University of Technology, Beijing 100124, China. Hauptthemen laut MEDLINE: Automobile Driving, Cognition. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Special Project on Scientific Research and Development of Beijing Rehabilitation Hospital Affiliated to Capital Medical University, Beijing Municipal Science and Technology Program: Research and Translational Application of Clinical Characteristic Diagnostic and Treatment Techniques in the….

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the increasing complexity of urban roads and rising traffic flow, traffic safety has become a critical societal concern. Current research primarily addresses drivers’ attention, reaction speed, and perceptual abilities, but comprehensive assessments of cognitive abilities in complex traffic environments are lacking. This study, grounded in cognitive science and neuropsychology, identifies and quantitatively evaluates ten cognitive components related to driving decision-making, execution, and psychological states by analyzing video footage of drivers’ actions. Physiological data (e.g., Electrocardiogram (ECG), Electrodermal Activity (EDA)) and non-physiological data (e.g., Eye Tracking (ET)) are collected from simulated driving scenarios. A dual-branch Transformer network model is developed to extract temporal features from multimodal data, integrating these features through a weight adjustment strategy to predict driving-related cognitive abilities. Experiments on a multimodal driving dataset from the Computational Physiology Laboratory at the University of Houston, USA, yield an Accuracy (ACC) of 0.9908 and an F1-score of 0.9832, confirming the model’s effectiveness. This method effectively combines scale measurements and driving behavior under secondary tasks to assess cognitive abilities, providing a novel approach for driving risk assessment and traffic safety strategy development.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Automobile DrivingCognitionHumansMaleAttentionAdultDecision MakingFemaleElectrocardiographyEye-Tracking Technology

Stichwörter der Autor:innen

biosignalsdriving safetydriving-related cognitive abilitiesmultimodal

Autor:innen und Institutionen

  • Faculty of Information Science and Technology, Beijing University of Technology, Beijing 100124, China.

ORCID-Profile: Wenli Zhang

Förderung

  • Special Project on Scientific Research and Development of Beijing Rehabilitation Hospital Affiliated to Capital Medical University
  • Beijing Municipal Science and Technology Program: Research and Translational Application of Clinical Characteristic Diagnostic and Treatment Techniques in the…

Zitieren

APA

Li, Y., Liu, B., & Zhang, W. (2024). Driving-Related Cognitive Abilities Prediction Based on Transformer’s Multimodal Fusion Framework. Sensors, 25(1), 174. https://doi.org/10.3390/s25010174

Vancouver

Li Y, Liu B, Zhang W. Driving-Related Cognitive Abilities Prediction Based on Transformer’s Multimodal Fusion Framework. Sensors. 2024;25(1):174. doi:10.3390/s25010174

BibTeX
@article{Li2024,
  author = {Li, Yifan and Liu, Bo and Zhang, Wenli},
  title = {Driving-Related Cognitive Abilities Prediction Based on Transformer’s Multimodal Fusion Framework},
  journal = {Sensors},
  year = {2024},
  volume = {25},
  number = {1},
  pages = {174},
  doi = {10.3390/s25010174}
}
Kostenlos starten →