DressCode: Autoregressively Sewing and Generating Garments from Text Guidance
ACM Transactions on Graphics · 19.07.2024 · 43 (4) · 1-13
DOI: 10.1145/3658147 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 19.07.2024. Verfasst von Kai He und 5 weiteren Autor:innen. Die Arbeit wurde bisher 63-mal zitiert (Crossref) und nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NSFC programs, STCSM, SHMEC.
Abstract (Originalsprache)
Apparel's significant role in human appearance underscores the importance of garment digitalization for digital human creation. Recent advances in 3D content creation are pivotal for digital human creation. Nonetheless, garment generation from text guidance is still nascent. We introduce a text-driven 3D garment generation framework, DressCode, which aims to democratize design for novices and offer immense potential in fashion design, virtual try-on, and digital human creation. We first introduce SewingGPT, a GPT-based architecture integrating cross-attention with text-conditioned embedding to generate sewing patterns with text guidance. We then tailor a pre-trained Stable Diffusion to generate tile-based Physically-based Rendering (PBR) textures for the garments. By leveraging a large language model, our framework generates CG-friendly garments through natural language interaction. It also facilitates pattern completion and texture editing, streamlining the design process through user-friendly interaction. This framework fosters innovation by allowing creators to freely experiment with designs and incorporate unique elements into their work. With comprehensive evaluations and comparisons with other state-of-the-art methods, our method showcases superior quality and alignment with input prompts. User studies further validate our high-quality rendering results, highlighting its practical utility and potential in production settings. Our project page is https://IHe-KaiI.github.io/DressCode/.
Förderung
- NSFC programs
- STCSM
- SHMEC
- National Key R&D Program of China
Zitieren
APA
He, K., Yao, K., Zhang, Q., Yu, J., Liu, L., & Xu, L. (2024). DressCode: Autoregressively Sewing and Generating Garments from Text Guidance. ACM Transactions on Graphics, 43(4), 1-13. https://doi.org/10.1145/3658147
Vancouver
He K, Yao K, Zhang Q, Yu J, Liu L, Xu L. DressCode: Autoregressively Sewing and Generating Garments from Text Guidance. ACM Transactions on Graphics. 2024;43(4):1-13. doi:10.1145/3658147
BibTeX
@article{He2024,
author = {He, Kai and Yao, Kaixin and Zhang, Qixuan and Yu, Jingyi and Liu, Lingjie and Xu, Lan},
title = {DressCode: Autoregressively Sewing and Generating Garments from Text Guidance},
journal = {ACM Transactions on Graphics},
year = {2024},
volume = {43},
number = {4},
pages = {1--13},
doi = {10.1145/3658147}
}
EUVIMED