EUVIMEDEUVIMED entdecken
Crossref

SCALE-Pose: Skeletal Correction and Language Knowledge-assisted for 3D Human Pose Estimation

Yaochen Li, Xinnan Ma, Limeng Zhao, Chenxu Zhou, Jiahui Feng, Yuehu Liu

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.05.2026 · 22 (5) · 1-23

DOI: 10.1145/3800573 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 20.04.2026. Verfasst von Yaochen Li und 5 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transformer-based 3D human pose estimation methods typically use 2D joint sequences as inputs, leveraging spatial and temporal transformer encoders to model the 3D human pose. However, these methods often fail to incorporate skeletal constraints to limit joint motion. The integration of prior category knowledge to enhance joint representations is also neglected. To address these challenges, a novel approach named SCALE-Pose is proposed in this article. Our method first constructs a feature extraction network based on spatiotemporal skeleton refinement, where the skeletal correction modules are designed within both the spatial and temporal skeleton encoders to enhance the backbone network’s understanding of skeletal features. Meanwhile, a weighted average joint position error loss function is applied to improve the network’s ability to represent the joints with varying difficulty levels. A new radian-based loss function for skeletal joint angles is also designed, further enhancing the model’s capability to capture subtle skeletal movements. Furthermore, a training strategy based on large language model (LLM) priors is proposed to generate category-specific prior semantic knowledge from category keywords, which is then incorporated as auxiliary information to extract motion features. The experimental results based on the Human3.6M and MPI-INF-3DHP datasets well demonstrate the effectiveness of the proposed method.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Li, Y., Ma, X., Zhao, L., Zhou, C., Feng, J., & Liu, Y. (2026). SCALE-Pose: Skeletal Correction and Language Knowledge-assisted for 3D Human Pose Estimation. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(5), 1-23. https://doi.org/10.1145/3800573

Vancouver

Li Y, Ma X, Zhao L, Zhou C, Feng J, Liu Y. SCALE-Pose: Skeletal Correction and Language Knowledge-assisted for 3D Human Pose Estimation. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(5):1-23. doi:10.1145/3800573

BibTeX
@article{Li2026,
  author = {Li, Yaochen and Ma, Xinnan and Zhao, Limeng and Zhou, Chenxu and Feng, Jiahui and Liu, Yuehu},
  title = {SCALE-Pose: Skeletal Correction and Language Knowledge-assisted for 3D Human Pose Estimation},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2026},
  volume = {22},
  number = {5},
  pages = {1--23},
  doi = {10.1145/3800573}
}
Kostenlos starten →