Pose ResNet: 3D Human Pose Estimation Based on Self-Supervision
Sensors · 2023
DOI: 10.3390/s23063057 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Wenxia Bao und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Electronics and Information Engineering, Anhui University, Hefei 230601, China. Hauptthemen laut MEDLINE: Self-Management, Automobile Driving. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, Major Natural Science Research Projects in Colleges and Universities of Anhui Province, Key Research and Technology Development Projects of Anhui Province.
Abstract (Originalsprache)
The accurate estimation of a 3D human pose is of great importance in many fields, such as human–computer interaction, motion recognition and automatic driving. In view of the difficulty of obtaining 3D ground truth labels for a dataset of 3D pose estimation techniques, we take 2D images as the research object in this paper, and propose a self-supervised 3D pose estimation model called Pose ResNet. ResNet50 is used as the basic network for extract features. First, a convolutional block attention module (CBAM) was introduced to refine selection of significant pixels. Then, a waterfall atrous spatial pooling (WASP) module is used to capture multi-scale contextual information from the extracted features to increase the receptive field. Finally, the features are input into a deconvolution network to acquire the volume heat map, which is later processed by a soft argmax function to obtain the coordinates of the joints. In addition to the two learning strategies of transfer learning and synthetic occlusion, a self-supervised training method is also used in this model, in which the 3D labels are constructed by the epipolar geometry transformation to supervise the training of the network. Without the need for 3D ground truths for the dataset, accurate estimation of the 3D human pose can be realized from a single 2D image. The results show that the mean per joint position error (MPJPE) is 74.6 mm without the need for 3D ground truth labels. Compared with other approaches, the proposed method achieves better results.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Electronics and Information Engineering, Anhui University, Hefei 230601, China.
- Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China.
Förderung
- National Key Research and Development Program of China
- Major Natural Science Research Projects in Colleges and Universities of Anhui Province
- Key Research and Technology Development Projects of Anhui Province
- Natural Science Research Projects in Colleges and Universities of Anhui Province
Zitieren
APA
Bao, W., Ma, Z., Liang, D., Yang, X., & Niu, T. (2023). Pose ResNet: 3D Human Pose Estimation Based on Self-Supervision. Sensors. https://doi.org/10.3390/s23063057
Vancouver
Bao W, Ma Z, Liang D, Yang X, Niu T. Pose ResNet: 3D Human Pose Estimation Based on Self-Supervision. Sensors. 2023. doi:10.3390/s23063057
BibTeX
@article{Bao2023,
author = {Bao, Wenxia and Ma, Zhongyu and Liang, Dong and Yang, Xianjun and Niu, Tao},
title = {Pose ResNet: 3D Human Pose Estimation Based on Self-Supervision},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23063057}
}
EUVIMED