EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ElasticGS: Pose-Aware Dynamic Gaussian Adaptation for Geometry-Consistent Human Digital Twin Reconstruction from Monocular Video

Dong Zhou iD, Zhe Huang iD, Haiyang Li iD, Mengyun Cao iD, Chih-Cheng Chen iD

Sensors · 06.11.2026 · 26 (21) · 7014

DOI: 10.3390/s26217014 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 06.11.2026. Verfasst von Dong Zhou und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Engineering, Jimei University, Xiamen 361021, China. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Fujian Province, Natural Science Foundation of Xiamen, National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision-based 3D sensing provides an effective approach for constructing human-centric digital twins in applications such as ergonomic assessment and human–robot collaboration. However, reconstructing reliable dynamic human digital twins from visual sensor observations remains challenging due to large articulated deformation, which often causes surface discontinuities in existing 3D Gaussian Splatting (3DGS)-based human avatars. Although current methods achieve high image-level rendering quality, their Gaussian primitives are not explicitly adapted to pose-induced surface deformation, resulting in cracks and holes during motion. In this work, we propose ElasticGS, a geometry-consistent human digital twin reconstruction framework for vision-based 3D sensing. ElasticGS introduces a training-free Pose-Aware Dynamic Covariance Adaptation strategy, which dynamically adjusts the rotation and anisotropic scale of Gaussian primitives according to local human surface deformation. Specifically, localized Principal Component Analysis (PCA) is performed on deformed SMPL-X mesh neighborhoods to estimate surface stretching directions and magnitudes, enabling Gaussian representations to maintain continuous surface coverage under complex poses. Furthermore, we propose the Avatar Surface Integrity Score (ASIS), a reference-free metric that evaluates structural completeness and surface compactness of reconstructed human avatars without requiring pixel-aligned ground truth. Experiments on the X-Humans, AvatarReX, and People-Snapshot datasets demonstrate that ElasticGS significantly improves surface integrity while maintaining competitive image-level sensing consistency. Compared with ExAvatar, ElasticGS maintains satisfactory rendering quality while improving ASIS from 0.741 to 0.961 on X-Humans, from 0.871 to 0.949 on AvatarReX, and from 0.874 to 0.952 on People-Snapshot. These results demonstrate the effectiveness of pose-aware covariance adaptation for robust human digital twin reconstruction in vision-based 3D sensing systems.

Schlagwörter

Stichwörter der Autor:innen

3D Gaussian Splattingdynamic human reconstructionhuman digital twinsurface integrity evaluationvision-based 3D sensing

Autor:innen und Institutionen

  • School of Computer Engineering, Jimei University, Xiamen 361021, China.
  • Department of Automatic Control Engineering, Feng Chia University, Taichung 40724, Taiwan.

ORCID-Profile: Dong Zhou, Zhe Huang, Haiyang Li, Mengyun Cao, Chih-Cheng Chen

Förderung

  • Natural Science Foundation of Fujian Province
  • Natural Science Foundation of Xiamen
  • National Natural Science Foundation of China
  • Open Competition for Innovative Projects of Xiamen

Zitieren

APA

Zhou, D., Huang, Z., Li, H., Cao, M., & Chen, C. C. (2026). ElasticGS: Pose-Aware Dynamic Gaussian Adaptation for Geometry-Consistent Human Digital Twin Reconstruction from Monocular Video. Sensors, 26(21), 7014. https://doi.org/10.3390/s26217014

Vancouver

Zhou D, Huang Z, Li H, Cao M, Chen CC. ElasticGS: Pose-Aware Dynamic Gaussian Adaptation for Geometry-Consistent Human Digital Twin Reconstruction from Monocular Video. Sensors. 2026;26(21):7014. doi:10.3390/s26217014

BibTeX
@article{Zhou2026,
  author = {Zhou, Dong and Huang, Zhe and Li, Haiyang and Cao, Mengyun and Chen, Chih-Cheng},
  title = {ElasticGS: Pose-Aware Dynamic Gaussian Adaptation for Geometry-Consistent Human Digital Twin Reconstruction from Monocular Video},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {21},
  pages = {7014},
  doi = {10.3390/s26217014}
}
Kostenlos starten →