EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Driver Head–Hand Cooperative Action Recognition Based on FMCW Millimeter-Wave Radar and Deep Learning

Lianlong Zhang, Xiaodong Chen, Zexin Chen iD, Jiawen Zheng iD, Yinliang Diao iD

Sensors · 10.04.2025 · 25 (8) · 2399

DOI: 10.3390/s25082399 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 10.04.2025. Verfasst von Lianlong Zhang und 4 weiteren Autor:innen. Beteiligte Einrichtung: College of Electronic Engineering, South China Agricultural University, Guangzhou 510642, China. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Beijing, Guangdong Basic and Applied Basic Research Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Driver status plays a critical role in ensuring driving safety. However, the current visual recognition-based methods for detecting driver actions and status are often limited to factors such as ambient light condition, occlusion, and privacy concerns. In contrast, millimeter-wave radar offers various advantages such as high accuracy, ease of integration, insensitivity to light condition, and low cost; therefore, it has been widely used for monitoring vital signals and in action recognition. Despite this, the existing studies on driver action recognition have been hindered by limited accuracy and a narrow range of detectable actions. In this study, we utilized a 77 GHz millimeter-wave frequency-modulated continuous-wave radar to construct a dataset encompassing seven types of driver head–hand cooperative actions. Furthermore, a deep learning network model based on VGG16-LSTM-CBAM using micro-Doppler spectrograms as input was developed for action classification. The experimental results demonstrated that, compared to the existing CNN-LSTM and ALEXNET-LSTM networks, the proposed network achieves a classification accuracy of 99.16%, effectively improving driver action detection.

Schlagwörter

Stichwörter der Autor:innen

deep learningdriver behavior detectionmicro-Doppler spectrummillimeter-wave radar

Autor:innen und Institutionen

  • College of Electronic Engineering, South China Agricultural University, Guangzhou 510642, China.

ORCID-Profile: Zexin Chen, Jiawen Zheng, Yinliang Diao

Förderung

  • Natural Science Foundation of Beijing
  • Guangdong Basic and Applied Basic Research Foundation

Zitieren

APA

Zhang, L., Chen, X., Chen, Z., Zheng, J., & Diao, Y. (2025). Driver Head–Hand Cooperative Action Recognition Based on FMCW Millimeter-Wave Radar and Deep Learning. Sensors, 25(8), 2399. https://doi.org/10.3390/s25082399

Vancouver

Zhang L, Chen X, Chen Z, Zheng J, Diao Y. Driver Head–Hand Cooperative Action Recognition Based on FMCW Millimeter-Wave Radar and Deep Learning. Sensors. 2025;25(8):2399. doi:10.3390/s25082399

BibTeX
@article{Zhang2025,
  author = {Zhang, Lianlong and Chen, Xiaodong and Chen, Zexin and Zheng, Jiawen and Diao, Yinliang},
  title = {Driver Head–Hand Cooperative Action Recognition Based on FMCW Millimeter-Wave Radar and Deep Learning},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {8},
  pages = {2399},
  doi = {10.3390/s25082399}
}
Kostenlos starten →