Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors
ACM Transactions on Multimedia Computing, Communications, and Applications · 29.02.2024 · 20 (2) · 1-19
DOI: 10.1145/3564700 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 25.09.2023. Verfasst von Xiaowei Chen und 7 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Open Project Program of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University.
Abstract (Originalsprache)
Human motion tracking is a fundamental building block for various applications including computer animation, human-computer interaction, healthcare, and so on. To reduce the burden of wearing multiple sensors, human motion prediction from sparse sensor inputs has become a hot topic in human motion tracking. However, such predictions are non-trivial as (i) the widely adopted data-driven approaches can easily collapse to average poses, and (ii) the predicted motions contain unnatural jitters. In this work, we address the aforementioned issues by proposing a novel framework which can accurately predict the human joint moving angles from the signals of only four flexible sensors, thereby achieving the tracking of human joints in multi-degrees of freedom. Specifically, we mitigate the collapse to average poses by implementing the model with a Bi-LSTM neural network that makes full use of short-time sequence information; we reduce jitters by adding a median pooling layer to the network, which smooths consecutive motions. Although being bio-compatible and ideal for improving the wearing experience, the flexible sensors are prone to aging which increases prediction errors. Observing that the aging of flexible sensors usually results in drifts of their resistance ranges, we further propose a novel dynamic calibration technique to rescale sensor ranges, which further improves the prediction accuracy. Experimental results show that our method achieves a low and stable tracking error of 4.51 degrees across different motion types with only four sensors.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Open Project Program of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University
- Science and Technology Guiding Project of Fujian Province
- Key Research Program of Jiangxi Province
- Natural Science Foundation of Fujian Province of China
- Key Project of National Key R&D Project
- Industry-University-Research Cooperation Project of Fujian Science and Technology Planning
Zitieren
APA
Chen, X., Jiang, X., Zhan, L., Guo, S., Ruan, Q., Luo, G., Liao, M., & Qin, Y. (2024). Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(2), 1-19. https://doi.org/10.1145/3564700
Vancouver
Chen X, Jiang X, Zhan L, Guo S, Ruan Q, Luo G, et al. Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(2):1-19. doi:10.1145/3564700
BibTeX
@article{Chen2024,
author = {Chen, Xiaowei and Jiang, Xiao and Zhan, Lishuang and Guo, Shihui and Ruan, Qunsheng and Luo, Guoliang and Liao, Minghong and Qin, Yipeng},
title = {Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2024},
volume = {20},
number = {2},
pages = {1--19},
doi = {10.1145/3564700}
}
EUVIMED