Human Parsing with Joint Learning for Dynamic mmWave Radar Point Cloud
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · 27.03.2023 · 7 (1) · 1-22
DOI: 10.1145/3580779 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, online erschienen am 28.03.2023. Verfasst von Shuai Wang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 59 Literaturangaben.
Abstract (Originalsprache)
Human sensing and understanding is a key requirement for many intelligent systems, such as smart monitoring, human-computer interaction, and activity analysis, etc. In this paper, we present mmParse, the first human parsing design for dynamic point cloud from commercial millimeter-wave radar devices. mmParse proposes an end-to-end neural network design that addresses the inherent challenges in parsing mmWave point cloud (e.g., sparsity and specular reflection). First, we design a novel multi-task learning approach, in which an auxiliary task can guide the network to understand human structural features. Secondly, we introduce a multi-task feature fusion method that incorporates both intra-task and inter-task attention to aggregate spatio-temporal features of the subject from a global view. Through extensive experiments in both indoor and outdoor environments, we demonstrate that our proposed system is able to achieve ~ 92% accuracy and ~ 84% IoU accuracy. We also show that the predicted semantic labels can increase the performance of two downstream tasks (pose estimation and action recognition) by ~ 18% and ~ 6% respectively.
Zitieren
APA
Wang, S., Cao, D., Liu, R., Jiang, W., Yao, T., & Lu, C. X. (2023). Human Parsing with Joint Learning for Dynamic mmWave Radar Point Cloud. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 7(1), 1-22. https://doi.org/10.1145/3580779
Vancouver
Wang S, Cao D, Liu R, Jiang W, Yao T, Lu CX. Human Parsing with Joint Learning for Dynamic mmWave Radar Point Cloud. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2023;7(1):1-22. doi:10.1145/3580779
BibTeX
@article{Wang2023,
author = {Wang, Shuai and Cao, Dongjiang and Liu, Ruofeng and Jiang, Wenchao and Yao, Tianshun and Lu, Chris Xiaoxuan},
title = {Human Parsing with Joint Learning for Dynamic mmWave Radar Point Cloud},
journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
year = {2023},
volume = {7},
number = {1},
pages = {1--22},
doi = {10.1145/3580779}
}
EUVIMED