Rodar: Robust Gesture Recognition Based on mmWave Radar Under Human Activity Interference
IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 11735-11749
DOI: 10.1109/tmc.2024.3402356 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Can Jin und 5 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Science and Technology Program of Liaoning Province, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Using mmWave radar to conduct gesture recognition is a promising solution for human-computer interaction. Although many studies have shown initial success, two-fold problems still remain unsolved, namely, the high-strength human activity interference and the difficulty in handling similar gestures. In light of these, we develop a robust mmWave radar based gesture recognition system, Rodar, to achieve accurate recognition of similar gestures under high-strength human activity interference, where a Multi-view De-interference Transformer (MvDeFormer) network is proposed. Specifically, to deal with the strong human activity interference, we design a DeFormer module to capture the useful gesture features by learning different patterns between gestures and interference, thereby reducing the impact of interference. Then, we develop a hierarchical multi-view fusion module to first extract the enhanced features within each view, and effectively fuse them across various views for final recognition. To evaluate the proposed Rodar system, we construct a dataset with seven similar gestures under three common human activity interference scenarios. Experimental results show that the accuracy can achieve up to 93.01%.
Förderung
- National Natural Science Foundation of China
- Science and Technology Program of Liaoning Province
- Fundamental Research Funds for the Central Universities
- Dalian Science and Technology Innovation Fund
- National Science Foundation
- Hong Kong SAR
- Global STEM Professorship and the Hong Kong Jockey Club
Zitieren
APA
Jin, C., Meng, X., Li, X., Wang, J., Pan, M., & Fang, Y. (2024). Rodar: Robust Gesture Recognition Based on mmWave Radar Under Human Activity Interference. IEEE Transactions on Mobile Computing, 23(12), 11735-11749. https://doi.org/10.1109/tmc.2024.3402356
Vancouver
Jin C, Meng X, Li X, Wang J, Pan M, Fang Y. Rodar: Robust Gesture Recognition Based on mmWave Radar Under Human Activity Interference. IEEE Transactions on Mobile Computing. 2024;23(12):11735-11749. doi:10.1109/tmc.2024.3402356
BibTeX
@article{Jin2024,
author = {Jin, Can and Meng, Xiangzhu and Li, Xuanheng and Wang, Jie and Pan, Miao and Fang, Yuguang},
title = {Rodar: Robust Gesture Recognition Based on mmWave Radar Under Human Activity Interference},
journal = {IEEE Transactions on Mobile Computing},
year = {2024},
volume = {23},
number = {12},
pages = {11735--11749},
doi = {10.1109/tmc.2024.3402356}
}
EUVIMED