EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TRANS-CNN-Based Gesture Recognition for mmWave Radar

Huafeng Zhang iD, Kang Liu iD, Yuanhui Zhang, Jihong Lin

Sensors · 11.03.2024 · 24 (6) · 1800

DOI: 10.3390/s24061800 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 11.03.2024. Verfasst von Huafeng Zhang und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Mechanical and Electrical Engineering, China Jiliang University, Hangzhou 310018, China. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: mmWave Radar Joint Lab Project, Natural Science Foundation of Zhejiang Province of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In order to improve the real-time performance of gesture recognition by a micro-Doppler map of mmWave radar, the point cloud based gesture recognition for mmWave radar is proposed in this paper. Two steps are carried out for mmWave radar-based gesture recognition. The first step is to estimate the point cloud of the gestures by 3D-FFT and the peak grouping. The second step is to train the TRANS-CNN model by combining the multi-head self-attention and the 1D-convolutional network so as to extract the features in the point cloud data at a deeper level to categorize the gestures. In the experiments, TI mmWave radar sensor IWR1642 is used as a benchmark to evaluate the feasibility of the proposed approach. The results show that the accuracy of the gesture recognition reaches 98.5%. In order to prove the effectiveness of our approach, a simply 2Tx2Rx radar sensor is developed in our lab, and the accuracy of recognition reaches 97.1%. The results show that our proposed gesture recognition approach achieves the best performance in real time with limited training data in comparison with the existing methods.

Schlagwörter

Stichwörter der Autor:innen

TRANS-CNNdynamic gesture recognitionmmWave radarmulti-head self-attention mechanismpoint cloud

Autor:innen und Institutionen

  • College of Mechanical and Electrical Engineering, China Jiliang University, Hangzhou 310018, China.

ORCID-Profile: Huafeng Zhang, Kang Liu

Förderung

  • mmWave Radar Joint Lab Project
  • Natural Science Foundation of Zhejiang Province of China

Zitieren

APA

Zhang, H., Liu, K., Zhang, Y., & Lin, J. (2024). TRANS-CNN-Based Gesture Recognition for mmWave Radar. Sensors, 24(6), 1800. https://doi.org/10.3390/s24061800

Vancouver

Zhang H, Liu K, Zhang Y, Lin J. TRANS-CNN-Based Gesture Recognition for mmWave Radar. Sensors. 2024;24(6):1800. doi:10.3390/s24061800

BibTeX
@article{Zhang2024,
  author = {Zhang, Huafeng and Liu, Kang and Zhang, Yuanhui and Lin, Jihong},
  title = {TRANS-CNN-Based Gesture Recognition for mmWave Radar},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {6},
  pages = {1800},
  doi = {10.3390/s24061800}
}
Kostenlos starten →