EUVIMEDEUVIMED entdecken
Crossref

G 3 R: Generating Rich and Fine-Grained mmWave Radar Data From 2D Videos for Generalized Gesture Recognition

Kaikai Deng, Dong Zhao, Wenxin Zheng, Yue Ling, Kangwen Yin, Huadong Ma

IEEE Transactions on Mobile Computing · 2025-04 · 24 (4) · 2917-2934

DOI: 10.1109/tmc.2024.3502668 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2025-04. Verfasst von Kaikai Deng und 5 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 67 Literaturangaben. Gefördert von: Innovation Research Group Project of NSFC, National Natural Science Foundation of China, Beijing Natural Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Millimeter wave radar is gaining traction recently as a promising modality for enabling pervasive and privacy-preserving gesture recognition. However, the lack of rich and fine-grained radar datasets hinders progress in developing generalized deep learning models for gesture recognition across various user postures (e.g., standing, sitting), positions, and scenes. To remedy this, we resort to designing a software pipeline that exploits wealthy 2D videos to generate realistic radar data, but it needs to address the challenge of simulating diversified and fine-grained reflection properties of user gestures. To this end, we design G 3 R with three key components: i) a gesture reflection point generator expands the arm's skeleton points to form human reflection points; ii) a signal simulation model simulates the multipath reflection and attenuation of radar signals to output the human intensity map; iii) an encoder-decoder model combines a sampling module and a fitting module to address the differences in number and distribution of points between generated and real-world radar data for generating realistic radar data. We implement and evaluate G 3 R using 2D videos from public data sources and self-collected real-world radar data, demonstrating its superiority over other state-of-the-art approaches for gesture recognition.

Förderung

  • Innovation Research Group Project of NSFC
  • National Natural Science Foundation of China
  • Beijing Natural Science Foundation
  • Higher Education Discipline Innovation Project

Zitieren

APA

Deng, K., Zhao, D., Zheng, W., Ling, Y., Yin, K., & Ma, H. (2025). G 3 R: Generating Rich and Fine-Grained mmWave Radar Data From 2D Videos for Generalized Gesture Recognition. IEEE Transactions on Mobile Computing, 24(4), 2917-2934. https://doi.org/10.1109/tmc.2024.3502668

Vancouver

Deng K, Zhao D, Zheng W, Ling Y, Yin K, Ma H. G 3 R: Generating Rich and Fine-Grained mmWave Radar Data From 2D Videos for Generalized Gesture Recognition. IEEE Transactions on Mobile Computing. 2025;24(4):2917-2934. doi:10.1109/tmc.2024.3502668

BibTeX
@article{Deng2025,
  author = {Deng, Kaikai and Zhao, Dong and Zheng, Wenxin and Ling, Yue and Yin, Kangwen and Ma, Huadong},
  title = {G 3 R: Generating Rich and Fine-Grained mmWave Radar Data From 2D Videos for Generalized Gesture Recognition},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2025},
  volume = {24},
  number = {4},
  pages = {2917--2934},
  doi = {10.1109/tmc.2024.3502668}
}
Kostenlos starten →