EUVIMEDEUVIMED entdecken
Crossref

Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors

Xiaowei Chen, Xiao Jiang, Lishuang Zhan, Shihui Guo, Qunsheng Ruan, Guoliang Luo, Minghong Liao, Yipeng Qin

ACM Transactions on Multimedia Computing, Communications, and Applications · 29.02.2024 · 20 (2) · 1-19

DOI: 10.1145/3564700 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 25.09.2023. Verfasst von Xiaowei Chen und 7 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Open Project Program of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Human motion tracking is a fundamental building block for various applications including computer animation, human-computer interaction, healthcare, and so on. To reduce the burden of wearing multiple sensors, human motion prediction from sparse sensor inputs has become a hot topic in human motion tracking. However, such predictions are non-trivial as (i) the widely adopted data-driven approaches can easily collapse to average poses, and (ii) the predicted motions contain unnatural jitters. In this work, we address the aforementioned issues by proposing a novel framework which can accurately predict the human joint moving angles from the signals of only four flexible sensors, thereby achieving the tracking of human joints in multi-degrees of freedom. Specifically, we mitigate the collapse to average poses by implementing the model with a Bi-LSTM neural network that makes full use of short-time sequence information; we reduce jitters by adding a median pooling layer to the network, which smooths consecutive motions. Although being bio-compatible and ideal for improving the wearing experience, the flexible sensors are prone to aging which increases prediction errors. Observing that the aging of flexible sensors usually results in drifts of their resistance ranges, we further propose a novel dynamic calibration technique to rescale sensor ranges, which further improves the prediction accuracy. Experimental results show that our method achieves a low and stable tracking error of 4.51 degrees across different motion types with only four sensors.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities
  • Open Project Program of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University
  • Science and Technology Guiding Project of Fujian Province
  • Key Research Program of Jiangxi Province
  • Natural Science Foundation of Fujian Province of China
  • Key Project of National Key R&D Project
  • Industry-University-Research Cooperation Project of Fujian Science and Technology Planning

Zitieren

APA

Chen, X., Jiang, X., Zhan, L., Guo, S., Ruan, Q., Luo, G., Liao, M., & Qin, Y. (2024). Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(2), 1-19. https://doi.org/10.1145/3564700

Vancouver

Chen X, Jiang X, Zhan L, Guo S, Ruan Q, Luo G, et al. Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(2):1-19. doi:10.1145/3564700

BibTeX
@article{Chen2024,
  author = {Chen, Xiaowei and Jiang, Xiao and Zhan, Lishuang and Guo, Shihui and Ruan, Qunsheng and Luo, Guoliang and Liao, Minghong and Qin, Yipeng},
  title = {Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2024},
  volume = {20},
  number = {2},
  pages = {1--19},
  doi = {10.1145/3564700}
}
Infokarte | EUVIMED

Artikeldaten derzeit nicht verfügbar.

Recherche