EUVIMEDEUVIMED entdecken
Crossref

MaterialPicker: Multi-Modal DiT-Based Material Generation

Xiaohe Ma, Valentin Deschaintre, Miloš Hašan, Fujun Luan, Kun Zhou, Hongzhi Wu, Yiwei Hu

ACM Transactions on Graphics · 01.08.2025 · 44 (4) · 1-12

DOI: 10.1145/3731199 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 27.07.2025. Verfasst von Xiaohe Ma und 6 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 60 Literaturangaben. Gefördert von: NSFC, XPLORER PRIZE, Information Technology Center and State Key Lab of CADCG, Zhejiang University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

High-quality material generation is key for virtual environment authoring and inverse rendering. We propose MaterialPicker, a multi-modal material generator leveraging a Diffusion Transformer (DiT) architecture, improving and simplifying the creation of high-quality materials from text prompts and/or photographs. Our method can generate a material based on an image crop of a material sample, even if the captured surface is distorted, viewed at an angle or partially occluded, as is often the case in photographs of natural scenes. We further allow the user to specify a text prompt to provide additional guidance for the generation. We finetune a pre-trained DiT-based video generator into a material generator, where each material map is treated as a frame in a video sequence. We evaluate our approach both quantitatively and qualitatively and show that it enables more diverse material generation and better distortion correction than previous work.

Förderung

  • NSFC
  • XPLORER PRIZE
  • Information Technology Center and State Key Lab of CADCG, Zhejiang University

Zitieren

APA

Ma, X., Deschaintre, V., Hašan, M., Luan, F., Zhou, K., Wu, H., & Hu, Y. (2025). MaterialPicker: Multi-Modal DiT-Based Material Generation. ACM Transactions on Graphics, 44(4), 1-12. https://doi.org/10.1145/3731199

Vancouver

Ma X, Deschaintre V, Hašan M, Luan F, Zhou K, Wu H, et al. MaterialPicker: Multi-Modal DiT-Based Material Generation. ACM Transactions on Graphics. 2025;44(4):1-12. doi:10.1145/3731199

BibTeX
@article{Ma2025,
  author = {Ma, Xiaohe and Deschaintre, Valentin and Hašan, Miloš and Luan, Fujun and Zhou, Kun and Wu, Hongzhi and Hu, Yiwei},
  title = {MaterialPicker: Multi-Modal DiT-Based Material Generation},
  journal = {ACM Transactions on Graphics},
  year = {2025},
  volume = {44},
  number = {4},
  pages = {1--12},
  doi = {10.1145/3731199}
}
Kostenlos starten →