EUVIMEDEUVIMED entdecken
Crossref

Midas++: Generating Training Data of mmWave Radars From Videos for Privacy-Preserving Human Sensing With Mobility

Kaikai Deng, Dong Zhao, Zihan Zhang, Shuyue Wang, Wenxin Zheng, Huadong Ma

IEEE Transactions on Mobile Computing · 2024-06 · 23 (6) · 6650-6666

DOI: 10.1109/tmc.2023.3325399 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-06. Verfasst von Kaikai Deng und 5 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: Innovation Research Group Project of NSFC, National Natural Science Foundation of China, Beijing Natural Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Millimeter wave radar is gaining traction recently for enabling privacy-preserving human sensing. However, the lack of large-scale, dynamic radar datasets impedes progress in developing robust and generalized deep learning models for mobile sensing applications. To address this problem, we resort to designing a software pipeline that leverages wealthy dynamic videos to generate synthetic radar data, but it faces two key challenges including i) incorrect camera and human positions leading to erroneous superposition of signal intensity and ii) the signal reflection of the background and humans in mobile scenes. To this end, we design Midas++ to utilize rich videos to generate realistic radar data via two components: (i) a human mesh fitting and calibration component calculates the camera ego-motion parameters to calibrate the extracted human positions; (ii) a reflection and noise signal estimation component combines several key modules, depth prediction , reflection model , and spatiotemporal noise estimation , to output coarse radar data, followed by a U-Net model to generate realistic radar data. We implement and evaluate Midas++ with video data from public data sources and real-world radar data, demonstrating that Midas++ outperforms other state-of-the-art approaches for both activity recognition and object detection tasks.

Förderung

  • Innovation Research Group Project of NSFC
  • National Natural Science Foundation of China
  • Beijing Natural Science Foundation
  • Higher Education Discipline Innovation Project

Zitieren

APA

Deng, K., Zhao, D., Zhang, Z., Wang, S., Zheng, W., & Ma, H. (2024). Midas++: Generating Training Data of mmWave Radars From Videos for Privacy-Preserving Human Sensing With Mobility. IEEE Transactions on Mobile Computing, 23(6), 6650-6666. https://doi.org/10.1109/tmc.2023.3325399

Vancouver

Deng K, Zhao D, Zhang Z, Wang S, Zheng W, Ma H. Midas++: Generating Training Data of mmWave Radars From Videos for Privacy-Preserving Human Sensing With Mobility. IEEE Transactions on Mobile Computing. 2024;23(6):6650-6666. doi:10.1109/tmc.2023.3325399

BibTeX
@article{Deng2024,
  author = {Deng, Kaikai and Zhao, Dong and Zhang, Zihan and Wang, Shuyue and Zheng, Wenxin and Ma, Huadong},
  title = {Midas++: Generating Training Data of mmWave Radars From Videos for Privacy-Preserving Human Sensing With Mobility},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2024},
  volume = {23},
  number = {6},
  pages = {6650--6666},
  doi = {10.1109/tmc.2023.3325399}
}
Kostenlos starten →