TEXGen: a Generative Diffusion Model for Mesh Textures
ACM Transactions on Graphics · 19.12.2024 · 43 (6) · 1-14
DOI: 10.1145/3687909 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 19.11.2024. Verfasst von Xin Yu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: Hong Kong Research Grant Council.
Abstract (Originalsprache)
While high-quality texture maps are essential for realistic 3D asset rendering, few studies have explored learning directly in the texture space, especially on large-scale datasets. In this work, we depart from the conventional approach of relying on pre-trained 2D diffusion models for testtime optimization of 3D textures. Instead, we focus on the fundamental problem of learning in the UV texture space itself. For the first time, we train a large diffusion model capable of directly generating high-resolution texture maps in a feed-forward manner. To facilitate efficient learning in high-resolution UV spaces, we propose a scalable network architecture that interleaves convolutions on UV maps with attention layers on point clouds. Leveraging this architectural design, we train a 700 million parameter diffusion model that can generate UV texture maps guided by text prompts and single-view images. Once trained, our model naturally supports various extended applications, including text-guided texture inpainting, sparse-view texture completion, and text-driven texture synthesis. The code is available at https://github.com/CVMI-Lab/TEXGen.
Förderung
- Hong Kong Research Grant Council
Zitieren
APA
Yu, X., Yuan, Z., Guo, Y., Liu, Y., Liu, J., Li, Y., Cao, Y., Liang, D., & Qi, X. (2024). TEXGen: a Generative Diffusion Model for Mesh Textures. ACM Transactions on Graphics, 43(6), 1-14. https://doi.org/10.1145/3687909
Vancouver
Yu X, Yuan Z, Guo Y, Liu Y, Liu J, Li Y, et al. TEXGen: a Generative Diffusion Model for Mesh Textures. ACM Transactions on Graphics. 2024;43(6):1-14. doi:10.1145/3687909
BibTeX
@article{Yu2024,
author = {Yu, Xin and Yuan, Ze and Guo, Yuan-Chen and Liu, Ying-Tian and Liu, Jianhui and Li, Yangguang and Cao, Yan-Pei and Liang, Ding and Qi, Xiaojuan},
title = {TEXGen: a Generative Diffusion Model for Mesh Textures},
journal = {ACM Transactions on Graphics},
year = {2024},
volume = {43},
number = {6},
pages = {1--14},
doi = {10.1145/3687909}
}
EUVIMED