Learned Universal Interoperable Virtual Try-ON
ACM Transactions on Graphics · 03.07.2026 · 45 (4) · 1-14
DOI: 10.1145/3811307 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 03.07.2026. Verfasst von Cong Cao und 7 weiteren Autor:innen. Die Arbeit nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
To enable large-scale reuse of real-world 3D assets-where garments and characters rarely share skeletons, templates, or dense correspondences-we present a fully automated virtual try-on system that dresses complex, multi-layer garments onto diverse, arbitrarily posed humanoids. Our key idea is to use SMPL as an intermediate proxy and decompose clothing-to-body transfer into two correspondence tasks with distinct challenges: (1) clothing-to-SMPL (partial-to-complete alignment) and (2) body-to-SMPL (large pose/shape variation and stylization). We address clothing-to-SMPL using a geometry-driven correspondence model, and introduce a diffusion-based body-to-SMPL correspondence approach that leverages multi-view consistent appearance features together with a pretrained 2D foundation model. Using these correspondences, we register SMPL/SMPL+D (Displacement) to the garment and target body and then perform simulator-driven fitting by transferring the garment along a smooth SMPL→SMPL+D transition, producing physically plausible draping on the target. Our system handles complex garment topology (including non-manifold meshes) and generalizes to a wide range of humanoid characters (e.g., humans, robots, cartoons, and creatures) while remaining computationally practical. Upon draping, our system also supports fast customization of clothing size. We show that our system can produce high-quality 3D clothing fittings without any human labor, even when 2D clothing sewing patterns are not available. Our project page is: https://cao-cong0.github.io/LUIVITON-Learned-Universal-Interoperable-VIrtual-Try-ON/.
Zitieren
APA
Cao, C., Cheng, X., Liu, J., Zheng, Y., Lin, Z., Li, R., Chkir, M., & Li, H. (2026). Learned Universal Interoperable Virtual Try-ON. ACM Transactions on Graphics, 45(4), 1-14. https://doi.org/10.1145/3811307
Vancouver
Cao C, Cheng X, Liu J, Zheng Y, Lin Z, Li R, et al. Learned Universal Interoperable Virtual Try-ON. ACM Transactions on Graphics. 2026;45(4):1-14. doi:10.1145/3811307
BibTeX
@article{Cao2026,
author = {Cao, Cong and Cheng, Xianhang and Liu, Jingyuan and Zheng, Yujian and Lin, Zhenhui and Li, Ren and Chkir, Meriem and Li, Hao},
title = {Learned Universal Interoperable Virtual Try-ON},
journal = {ACM Transactions on Graphics},
year = {2026},
volume = {45},
number = {4},
pages = {1--14},
doi = {10.1145/3811307}
}
EUVIMED