EUVIMEDEUVIMED entdecken
Crossref

Uranus: Empowering Generalized Gesture Recognition with Mobility through Generating Large-scale mmWave Radar Data

Yue Ling, Dong Zhao, Kaikai Deng, Kangwen Yin, Wenxin Zheng, Huadong Ma

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · 21.11.2024 · 8 (4) · 1-28

DOI: 10.1145/3699754 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, online erschienen am 21.11.2024. Verfasst von Yue Ling und 5 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 73 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Beijing Natural Science Foundation, 111 Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Millimeter-wave radar shows great sensing capabilities for pervasive and privacy-preserving gesture recognition. However, the lack of large-scale, dynamic radar datasets hinders the advancement of deep learning models for generalized gesture recognition in dynamic scenes. To address this problem, we opt for designing a system that employs wealthy dynamic 2D videos to generate realistic radar data, but it confronts two challenges including i) simulating the complex signal reflection characteristics of humans and the background and ii) extracting elusive gesture-relevant features from dynamic radar data. To this end, we design Uranus with two key components: (i) a dynamic data generation network (DDG-Net) combines several key modules, human reflection model, background reflection extractor, and data fitting model to simulate the signal reflection characteristics of humans and the background, followed by fitting the number and global distribution of points in point clouds to generate realistic radar data; (ii) a dynamic gesture recognition network (DGR-Net) combines two modules, spatial feature extraction and global feature fusion, to extract spatial and global features of points in point clouds, respectively, to achieve generalized gesture recognition. We implement and evaluate Uranus with dynamic video data from public video sources and self-collected radar data, demonstrating that Uranus outperforms the state-of-the-art approaches for gesture recognition in dynamic scenes.

Förderung

  • National Natural Science Foundation of China
  • Beijing Natural Science Foundation
  • 111 Project

Zitieren

APA

Ling, Y., Zhao, D., Deng, K., Yin, K., Zheng, W., & Ma, H. (2024). Uranus: Empowering Generalized Gesture Recognition with Mobility through Generating Large-scale mmWave Radar Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 8(4), 1-28. https://doi.org/10.1145/3699754

Vancouver

Ling Y, Zhao D, Deng K, Yin K, Zheng W, Ma H. Uranus: Empowering Generalized Gesture Recognition with Mobility through Generating Large-scale mmWave Radar Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2024;8(4):1-28. doi:10.1145/3699754

BibTeX
@article{Ling2024,
  author = {Ling, Yue and Zhao, Dong and Deng, Kaikai and Yin, Kangwen and Zheng, Wenxin and Ma, Huadong},
  title = {Uranus: Empowering Generalized Gesture Recognition with Mobility through Generating Large-scale mmWave Radar Data},
  journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
  year = {2024},
  volume = {8},
  number = {4},
  pages = {1--28},
  doi = {10.1145/3699754}
}
Kostenlos starten →