EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

A diffusion framework based on prompt-driven masks for part-level 3D editing

Jian-Ru Zhu, Hong-Yu Jian, Tyng-Yeu Liang

Journal of Computational Design and Engineering · 01.04.2026 · 13 (4) · 273-289

DOI: 10.1093/jcde/qwag035 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computational Design and Engineering, online erschienen am 02.04.2026. Verfasst von Jian-Ru Zhu und 2 weiteren Autor:innen. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Science and Technology Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The advancement of generative artificial intelligence, particularly with the advent of diffusion models and three-dimensional (3D) Gaussian Splatting (3DGS), has introduced novel avenues for manipulating and synthesizing 3D models. However, current 3D editing methods primarily focus on global style transfers or constrained geometric deformations. They face significant challenges in executing fine-grained, part-level manipulations guided by text prompts, especially for complex tasks that require simultaneous changes to both geometry and appearance. Many existing approaches operate at the rendering level, which hinders the creation of new geometric structures. To overcome these limitations, we propose Mask2-3D, a diffusion-based framework for prompt-driven, part-level 3D editing. The core of our framework is a learnable, multi-view mask generator that predicts a coherent editing region rather than just segmenting existing contours. This unique mechanism provides the flexibility to create new shape architectures and undergo significant geometric modifications. Furthermore, the system integrates a LoRA-finetuned diffusion model to facilitate high-fidelity content synthesis and style transfer within these designated regions, while a subsequent re-rendering process ensures multi-view consistency. By implementing this innovative workflow, Mask2-3D enables precise, flexible, and structurally sound local editing of 3D models via natural language commands, significantly enhancing the intuitiveness and creative freedom of the 3D content creation process.

Förderung

  • National Science and Technology Council

Zitieren

APA

Zhu, J., Jian, H., & Liang, T. (2026). A diffusion framework based on prompt-driven masks for part-level 3D editing. Journal of Computational Design and Engineering, 13(4), 273-289. https://doi.org/10.1093/jcde/qwag035

Vancouver

Zhu J, Jian H, Liang T. A diffusion framework based on prompt-driven masks for part-level 3D editing. Journal of Computational Design and Engineering. 2026;13(4):273-289. doi:10.1093/jcde/qwag035

BibTeX
@article{Zhu2026,
  author = {Zhu, Jian-Ru and Jian, Hong-Yu and Liang, Tyng-Yeu},
  title = {A diffusion framework based on prompt-driven masks for part-level 3D editing},
  journal = {Journal of Computational Design and Engineering},
  year = {2026},
  volume = {13},
  number = {4},
  pages = {273--289},
  doi = {10.1093/jcde/qwag035}
}
Kostenlos starten →