EUVIMEDEUVIMED entdecken
Crossref

Rodar: Robust Gesture Recognition Based on mmWave Radar Under Human Activity Interference

Can Jin, Xiangzhu Meng, Xuanheng Li, Jie Wang, Miao Pan, Yuguang Fang

IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 11735-11749

DOI: 10.1109/tmc.2024.3402356 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Can Jin und 5 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Science and Technology Program of Liaoning Province, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Using mmWave radar to conduct gesture recognition is a promising solution for human-computer interaction. Although many studies have shown initial success, two-fold problems still remain unsolved, namely, the high-strength human activity interference and the difficulty in handling similar gestures. In light of these, we develop a robust mmWave radar based gesture recognition system, Rodar, to achieve accurate recognition of similar gestures under high-strength human activity interference, where a Multi-view De-interference Transformer (MvDeFormer) network is proposed. Specifically, to deal with the strong human activity interference, we design a DeFormer module to capture the useful gesture features by learning different patterns between gestures and interference, thereby reducing the impact of interference. Then, we develop a hierarchical multi-view fusion module to first extract the enhanced features within each view, and effectively fuse them across various views for final recognition. To evaluate the proposed Rodar system, we construct a dataset with seven similar gestures under three common human activity interference scenarios. Experimental results show that the accuracy can achieve up to 93.01%.

Förderung

  • National Natural Science Foundation of China
  • Science and Technology Program of Liaoning Province
  • Fundamental Research Funds for the Central Universities
  • Dalian Science and Technology Innovation Fund
  • National Science Foundation
  • Hong Kong SAR
  • Global STEM Professorship and the Hong Kong Jockey Club

Zitieren

APA

Jin, C., Meng, X., Li, X., Wang, J., Pan, M., & Fang, Y. (2024). Rodar: Robust Gesture Recognition Based on mmWave Radar Under Human Activity Interference. IEEE Transactions on Mobile Computing, 23(12), 11735-11749. https://doi.org/10.1109/tmc.2024.3402356

Vancouver

Jin C, Meng X, Li X, Wang J, Pan M, Fang Y. Rodar: Robust Gesture Recognition Based on mmWave Radar Under Human Activity Interference. IEEE Transactions on Mobile Computing. 2024;23(12):11735-11749. doi:10.1109/tmc.2024.3402356

BibTeX
@article{Jin2024,
  author = {Jin, Can and Meng, Xiangzhu and Li, Xuanheng and Wang, Jie and Pan, Miao and Fang, Yuguang},
  title = {Rodar: Robust Gesture Recognition Based on mmWave Radar Under Human Activity Interference},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2024},
  volume = {23},
  number = {12},
  pages = {11735--11749},
  doi = {10.1109/tmc.2024.3402356}
}
Kostenlos starten →