EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

3D Human Pose Estimation from Monocular Video Sequences in Underwater Scenarios

Shuwen Liang iD, Hailong Liu, Ping Liu iD, Dong Zhang, Rong Yu, Xiaowei Zhou, Zhize Zhou iD

Sensors · 26.07.2026 · 26 (15) · 4738

DOI: 10.3390/s26154738 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 26.07.2026. Verfasst von Shuwen Liang und 6 weiteren Autor:innen. Beteiligte Einrichtung: Sports Biomechanics Center, Institute of Artificial Intelligence in Sports, Capital University of Physical Education and Sports, Beijing 100191, Chin…. Hauptthemen laut MEDLINE: Video Recording, Imaging, Three-Dimensional, Posture. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Beijing Municipal Universities, the Fundamental Research Funds for Beijing Municipal Universities.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a novel approach for estimating 3D human pose from monocular video sequences in underwater scenarios, tackling the unique challenges posed by water refraction, body occlusion, low image quality and illumination distortion in underwater environments. Leveraging both 2D keypoint extraction and parametric model estimation, our method operates in a two-stage framework including preprocessing and optimization. In the preprocessing stage, a Part Attention Regressor (PARE) is adopted to dynamically estimate SMPL human body parameters, particularly adept at handling occlusions common in underwater scenarios. Additionally, a 2D keypoint detector, employing YOLO for bounding box detection and HRNet for keypoint regression, enhances feature extraction despite underwater image challenges. In the optimization stage, we propose an underwater variational autoencoder (UW-VAE), which adopts a data-driven strategy to learn the biomechanical prior distribution of underwater human poses and implicitly correct unreasonable pose parameters caused by refraction and occlusion. The optimization process incorporates constraints aligning final SMPL models with detected 2D keypoints, minimizing disparity between adjusted and original SMPL models, and ensuring temporal consistency. Furthermore, to address the scarcity of annotated underwater datasets, we build a full pipeline to generate synthetic underwater datasets with complete annotations based on UW-VAE. Experimental results on the SwimXYZ synthetic dataset show that our method achieves 51.60% PCK@0.2 and 80.13% PCK@0.5, outperforming state-of-the-art land-based methods across most stroke categories. Validation on real-world underwater swimming datasets demonstrates improved 2D keypoint accuracy after synthetic-data fine-tuning, which provides a new solution for 3D human motion analysis in underwater sports, biomechanical research and swimming training.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Video RecordingImaging, Three-DimensionalPostureHumansAlgorithmsAutoencoderImage Processing, Computer-Assisted

Stichwörter der Autor:innen

human pose estimationsynthetic datasetunderwater

Autor:innen und Institutionen

  • Sports Biomechanics Center, Institute of Artificial Intelligence in Sports, Capital University of Physical Education and Sports, Beijing 100191, China.
  • State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou 310058, China.
  • Department of Leisure and Social Sports, Capital University of Physical Education and Sports, Beijing 100191, China.

ORCID-Profile: Shuwen Liang, Ping Liu, Zhize Zhou

Förderung

  • Beijing Municipal Universities
  • the Fundamental Research Funds for Beijing Municipal Universities

Zitieren

APA

Liang, S., Liu, H., Liu, P., Zhang, D., Yu, R., Zhou, X., & Zhou, Z. (2026). 3D Human Pose Estimation from Monocular Video Sequences in Underwater Scenarios. Sensors, 26(15), 4738. https://doi.org/10.3390/s26154738

Vancouver

Liang S, Liu H, Liu P, Zhang D, Yu R, Zhou X, et al. 3D Human Pose Estimation from Monocular Video Sequences in Underwater Scenarios. Sensors. 2026;26(15):4738. doi:10.3390/s26154738

BibTeX
@article{Liang2026,
  author = {Liang, Shuwen and Liu, Hailong and Liu, Ping and Zhang, Dong and Yu, Rong and Zhou, Xiaowei and Zhou, Zhize},
  title = {3D Human Pose Estimation from Monocular Video Sequences in Underwater Scenarios},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {15},
  pages = {4738},
  doi = {10.3390/s26154738}
}
Kostenlos starten →