A diffusion framework based on prompt-driven masks for part-level 3D editing
Journal of Computational Design and Engineering · 01.04.2026 · 13 (4) · 273-289
DOI: 10.1093/jcde/qwag035 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computational Design and Engineering, online erschienen am 02.04.2026. Verfasst von Jian-Ru Zhu und 2 weiteren Autor:innen. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Science and Technology Council.
Abstract (Originalsprache)
The advancement of generative artificial intelligence, particularly with the advent of diffusion models and three-dimensional (3D) Gaussian Splatting (3DGS), has introduced novel avenues for manipulating and synthesizing 3D models. However, current 3D editing methods primarily focus on global style transfers or constrained geometric deformations. They face significant challenges in executing fine-grained, part-level manipulations guided by text prompts, especially for complex tasks that require simultaneous changes to both geometry and appearance. Many existing approaches operate at the rendering level, which hinders the creation of new geometric structures. To overcome these limitations, we propose Mask2-3D, a diffusion-based framework for prompt-driven, part-level 3D editing. The core of our framework is a learnable, multi-view mask generator that predicts a coherent editing region rather than just segmenting existing contours. This unique mechanism provides the flexibility to create new shape architectures and undergo significant geometric modifications. Furthermore, the system integrates a LoRA-finetuned diffusion model to facilitate high-fidelity content synthesis and style transfer within these designated regions, while a subsequent re-rendering process ensures multi-view consistency. By implementing this innovative workflow, Mask2-3D enables precise, flexible, and structurally sound local editing of 3D models via natural language commands, significantly enhancing the intuitiveness and creative freedom of the 3D content creation process.
Förderung
- National Science and Technology Council
Zitieren
APA
Zhu, J., Jian, H., & Liang, T. (2026). A diffusion framework based on prompt-driven masks for part-level 3D editing. Journal of Computational Design and Engineering, 13(4), 273-289. https://doi.org/10.1093/jcde/qwag035
Vancouver
Zhu J, Jian H, Liang T. A diffusion framework based on prompt-driven masks for part-level 3D editing. Journal of Computational Design and Engineering. 2026;13(4):273-289. doi:10.1093/jcde/qwag035
BibTeX
@article{Zhu2026,
author = {Zhu, Jian-Ru and Jian, Hong-Yu and Liang, Tyng-Yeu},
title = {A diffusion framework based on prompt-driven masks for part-level 3D editing},
journal = {Journal of Computational Design and Engineering},
year = {2026},
volume = {13},
number = {4},
pages = {273--289},
doi = {10.1093/jcde/qwag035}
}
EUVIMED