Driving-Related Cognitive Abilities Prediction Based on Transformer’s Multimodal Fusion Framework
Sensors · 31.12.2024 · 25 (1) · 174
DOI: 10.3390/s25010174 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 31.12.2024. Verfasst von Yifan Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Information Science and Technology, Beijing University of Technology, Beijing 100124, China. Hauptthemen laut MEDLINE: Automobile Driving, Cognition. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Special Project on Scientific Research and Development of Beijing Rehabilitation Hospital Affiliated to Capital Medical University, Beijing Municipal Science and Technology Program: Research and Translational Application of Clinical Characteristic Diagnostic and Treatment Techniques in the….
Abstract (Originalsprache)
With the increasing complexity of urban roads and rising traffic flow, traffic safety has become a critical societal concern. Current research primarily addresses drivers’ attention, reaction speed, and perceptual abilities, but comprehensive assessments of cognitive abilities in complex traffic environments are lacking. This study, grounded in cognitive science and neuropsychology, identifies and quantitatively evaluates ten cognitive components related to driving decision-making, execution, and psychological states by analyzing video footage of drivers’ actions. Physiological data (e.g., Electrocardiogram (ECG), Electrodermal Activity (EDA)) and non-physiological data (e.g., Eye Tracking (ET)) are collected from simulated driving scenarios. A dual-branch Transformer network model is developed to extract temporal features from multimodal data, integrating these features through a weight adjustment strategy to predict driving-related cognitive abilities. Experiments on a multimodal driving dataset from the Computational Physiology Laboratory at the University of Houston, USA, yield an Accuracy (ACC) of 0.9908 and an F1-score of 0.9832, confirming the model’s effectiveness. This method effectively combines scale measurements and driving behavior under secondary tasks to assess cognitive abilities, providing a novel approach for driving risk assessment and traffic safety strategy development.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Information Science and Technology, Beijing University of Technology, Beijing 100124, China.
ORCID-Profile: Wenli Zhang
Förderung
- Special Project on Scientific Research and Development of Beijing Rehabilitation Hospital Affiliated to Capital Medical University
- Beijing Municipal Science and Technology Program: Research and Translational Application of Clinical Characteristic Diagnostic and Treatment Techniques in the…
Zitieren
APA
Li, Y., Liu, B., & Zhang, W. (2024). Driving-Related Cognitive Abilities Prediction Based on Transformer’s Multimodal Fusion Framework. Sensors, 25(1), 174. https://doi.org/10.3390/s25010174
Vancouver
Li Y, Liu B, Zhang W. Driving-Related Cognitive Abilities Prediction Based on Transformer’s Multimodal Fusion Framework. Sensors. 2024;25(1):174. doi:10.3390/s25010174
BibTeX
@article{Li2024,
author = {Li, Yifan and Liu, Bo and Zhang, Wenli},
title = {Driving-Related Cognitive Abilities Prediction Based on Transformer’s Multimodal Fusion Framework},
journal = {Sensors},
year = {2024},
volume = {25},
number = {1},
pages = {174},
doi = {10.3390/s25010174}
}
EUVIMED