Uranus: Empowering Generalized Gesture Recognition with Mobility through Generating Large-scale mmWave Radar Data
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · 21.11.2024 · 8 (4) · 1-28
DOI: 10.1145/3699754 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, online erschienen am 21.11.2024. Verfasst von Yue Ling und 5 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 73 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Beijing Natural Science Foundation, 111 Project.
Themen: Mobilisation
Abstract (Originalsprache)
Millimeter-wave radar shows great sensing capabilities for pervasive and privacy-preserving gesture recognition. However, the lack of large-scale, dynamic radar datasets hinders the advancement of deep learning models for generalized gesture recognition in dynamic scenes. To address this problem, we opt for designing a system that employs wealthy dynamic 2D videos to generate realistic radar data, but it confronts two challenges including i) simulating the complex signal reflection characteristics of humans and the background and ii) extracting elusive gesture-relevant features from dynamic radar data. To this end, we design Uranus with two key components: (i) a dynamic data generation network (DDG-Net) combines several key modules, human reflection model, background reflection extractor, and data fitting model to simulate the signal reflection characteristics of humans and the background, followed by fitting the number and global distribution of points in point clouds to generate realistic radar data; (ii) a dynamic gesture recognition network (DGR-Net) combines two modules, spatial feature extraction and global feature fusion, to extract spatial and global features of points in point clouds, respectively, to achieve generalized gesture recognition. We implement and evaluate Uranus with dynamic video data from public video sources and self-collected radar data, demonstrating that Uranus outperforms the state-of-the-art approaches for gesture recognition in dynamic scenes.
Förderung
- National Natural Science Foundation of China
- Beijing Natural Science Foundation
- 111 Project
Zitieren
APA
Ling, Y., Zhao, D., Deng, K., Yin, K., Zheng, W., & Ma, H. (2024). Uranus: Empowering Generalized Gesture Recognition with Mobility through Generating Large-scale mmWave Radar Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 8(4), 1-28. https://doi.org/10.1145/3699754
Vancouver
Ling Y, Zhao D, Deng K, Yin K, Zheng W, Ma H. Uranus: Empowering Generalized Gesture Recognition with Mobility through Generating Large-scale mmWave Radar Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2024;8(4):1-28. doi:10.1145/3699754
BibTeX
@article{Ling2024,
author = {Ling, Yue and Zhao, Dong and Deng, Kaikai and Yin, Kangwen and Zheng, Wenxin and Ma, Huadong},
title = {Uranus: Empowering Generalized Gesture Recognition with Mobility through Generating Large-scale mmWave Radar Data},
journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
year = {2024},
volume = {8},
number = {4},
pages = {1--28},
doi = {10.1145/3699754}
}
EUVIMED