EUVIMEDEUVIMED entdecken
Crossref

Classification of Driver Cognitive Load in Conditionally Automated Driving: Utilizing Electrocardiogram-Based Spectrogram with Lightweight Neural Network

Wenxin Shi, Zuyuan Wang, Ange Wang, Dengbo He

Transportation Research Record: Journal of the Transportation Research Board · 2024-12 · 2678 (12) · 1560-1573

DOI: 10.1177/03611981241252797 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transportation Research Record: Journal of the Transportation Research Board, online erschienen am 10.06.2024. Verfasst von Wenxin Shi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Project of Hetao Shenzhen-Hong Kong Science and Technology Innovation Cooperation Zone, Guangzhou Municipal Science and Technology Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the development of conditionally automated driving, drivers will be allowed to perform non-driving-related tasks. Under such circumstances, continuous monitoring of driver cognitive load will play an increasingly important role in ensuring that drivers have sufficient mental resources to take over control of the vehicle should the driving automation fail. However, estimation of cognitive load is challenging because of the difficulties in identifying high-level feature representation and accounting for interindividual differences. Physiological measures are believed to be promising candidates for cognitive load estimation in partially automated vehicles. However, current estimation methods are mainly based on the manual feature extraction of time- or frequency-domain indicators from physiological signals, which may not adapt to dynamic driving conditions. With the development of deep learning, the neural network has shown good performance in automatically capturing high-level features from input data. Inspired by this, we adopted a novel approach to classify driver cognitive load based on electrocardiogram (ECG) spectrograms, in which the driver’s ECG signal was collected and transformed into a 2D spectrogram by a short-time Fourier transform. A squeeze-and-excitation network-based deep-learning framework that can capture high-level features and pays more attention to the cognition-related features of the spectrogram was proposed for classification. Experiments on a publicly available dataset demonstrated that our model achieved an accuracy of 96.76% in differentiating two levels of cognitive load for a within-subject evaluation and 71.50% accuracy with an across-subjects evaluation. The results demonstrated the feasibility of detecting drivers’ cognitive load through deep learning using ECG spectrogram alone.

Förderung

  • National Natural Science Foundation of China
  • Project of Hetao Shenzhen-Hong Kong Science and Technology Innovation Cooperation Zone
  • Guangzhou Municipal Science and Technology Project
  • Guangzhou Science and Technology Program City-University Joint Funding

Zitieren

APA

Shi, W., Wang, Z., Wang, A., & He, D. (2024). Classification of Driver Cognitive Load in Conditionally Automated Driving: Utilizing Electrocardiogram-Based Spectrogram with Lightweight Neural Network. Transportation Research Record: Journal of the Transportation Research Board, 2678(12), 1560-1573. https://doi.org/10.1177/03611981241252797

Vancouver

Shi W, Wang Z, Wang A, He D. Classification of Driver Cognitive Load in Conditionally Automated Driving: Utilizing Electrocardiogram-Based Spectrogram with Lightweight Neural Network. Transportation Research Record: Journal of the Transportation Research Board. 2024;2678(12):1560-1573. doi:10.1177/03611981241252797

BibTeX
@article{Shi2024,
  author = {Shi, Wenxin and Wang, Zuyuan and Wang, Ange and He, Dengbo},
  title = {Classification of Driver Cognitive Load in Conditionally Automated Driving: Utilizing Electrocardiogram-Based Spectrogram with Lightweight Neural Network},
  journal = {Transportation Research Record: Journal of the Transportation Research Board},
  year = {2024},
  volume = {2678},
  number = {12},
  pages = {1560--1573},
  doi = {10.1177/03611981241252797}
}
Kostenlos starten →