3D Human Pose Estimation Based on Wearable IMUs and Multiple Camera Views
Electronics · 24.07.2024 · 13 (15) · 2926
DOI: 10.3390/electronics13152926 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 24.07.2024. Verfasst von Mingliang Chen und 1 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of Guangxi for modeling and control, Graduate Education Innovation Program of Guangxi University.
Abstract (Originalsprache)
The problem of 3D human pose estimation (HPE) has been the focus of research in recent years, yet precise estimation remains an under-explored challenge. In this paper, the merits of both multiview images and wearable IMUs are combined to enhance the process of 3D HPE. We build upon a state-of-the-art baseline while introducing three novelties. Initially, we enhance the precision of keypoint localization by substituting Gaussian kernels with Laplacian kernels in the generation of target heatmaps. Secondly, we incorporate orientation regularized network (ORN), which enhances cross-modal heatmap fusion by taking a weighted average of the top-scored values instead of solely relying on the maximum value. This not only improves robustness to outliers but also leads to higher accuracy in pose estimation. Lastly, we modify the limb length constraint in the conventional orientation regularized pictorial structure model (ORPSM) to improve the estimation of joint positions. Specifically, we devise a soft-coded binary term for limb length constraint, hence imposing a flexible and smoothed penalization and reducing sensitivity to hyperparameters. The experimental results using the TotalCapture dataset reveal a significant improvement, with a 10.3% increase in PCKh accuracy at the one-twelfth threshold and a 3.9 mm reduction in MPJPE error compared to the baseline.
Förderung
- National Natural Science Foundation of Guangxi for modeling and control
- Graduate Education Innovation Program of Guangxi University
Zitieren
APA
Chen, M., & Tan, G. (2024). 3D Human Pose Estimation Based on Wearable IMUs and Multiple Camera Views. Electronics, 13(15), 2926. https://doi.org/10.3390/electronics13152926
Vancouver
Chen M, Tan G. 3D Human Pose Estimation Based on Wearable IMUs and Multiple Camera Views. Electronics. 2024;13(15):2926. doi:10.3390/electronics13152926
BibTeX
@article{Chen2024,
author = {Chen, Mingliang and Tan, Guangxing},
title = {3D Human Pose Estimation Based on Wearable IMUs and Multiple Camera Views},
journal = {Electronics},
year = {2024},
volume = {13},
number = {15},
pages = {2926},
doi = {10.3390/electronics13152926}
}
EUVIMED