CloCap-GS: Clothed Human Performance Capture With 3D Gaussian Splatting
IEEE Transactions on Image Processing · 2025
DOI: 10.1109/tip.2025.3592534 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2025. Verfasst von Kangkan Wang und 3 weiteren Autor:innen. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional, Video Recording, Clothing. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 67 Literaturangaben. Gefördert von: Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Open Project Program of the State Key Laboratory of Computer-Aided Design and Computer Graphics (CAD&CG) of Zhejiang University.
Abstract (Originalsprache)
Capturing the human body and clothing from videos has obtained significant progress in recent years, but several challenges remain to be addressed. Previous methods reconstruct the 3D bodies and garments from videos with self-rotating human motions or capture the body and clothing separately based on neural implicit fields. However, the reconstruction methods for self-rotating motions may cause instable tracking on dynamic videos with arbitrary human motions, while implicit fields based methods are limited to inefficient rendering and low quality synthesis. To solve these problems, we propose a new method, called CloCap-GS, for clothed human performance capture with 3D Gaussian Splatting. Specifically, we align 3D Gaussians with the deforming geometries of body and clothing, and leverage photometric constraints formed by matching Gaussians renderings with input video frames to recover temporal deformations of the dense template geometry. The geometry deformations and Gaussians properties of both the body and clothing are optimized jointly, achieving both dense geometry tracking and novel-view synthesis. In addition, we introduce a physics-aware material-varying cloth model to preserve physically-plausible cloth dynamics and body-clothing interactions that is pre-trained in a self-supervised manner without preparing training data. Compared with the existing methods, our method improves the accuracy of dense geometry tracking and quality of novel-view synthesis for a variety of daily garment types (e.g., loose clothes). Extensive experiments in both quantitative and qualitative evaluations demonstrate the effectiveness of CloCap-GS on real sparse-view or monocular videos.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Open Project Program of the State Key Laboratory of Computer-Aided Design and Computer Graphics (CAD&CG) of Zhejiang University
Zitieren
APA
Wang, K., Wang, C., Yang, J., & Zhang, G. (2025). CloCap-GS: Clothed Human Performance Capture With 3D Gaussian Splatting. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2025.3592534
Vancouver
Wang K, Wang C, Yang J, Zhang G. CloCap-GS: Clothed Human Performance Capture With 3D Gaussian Splatting. IEEE Transactions on Image Processing. 2025. doi:10.1109/tip.2025.3592534
BibTeX
@article{Wang2025,
author = {Wang, Kangkan and Wang, Chong and Yang, Jian and Zhang, Guofeng},
title = {CloCap-GS: Clothed Human Performance Capture With 3D Gaussian Splatting},
journal = {IEEE Transactions on Image Processing},
year = {2025},
doi = {10.1109/tip.2025.3592534}
}
EUVIMED