Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields
IET Image Processing · 2024-10 · 18 (12) · 3507-3517
DOI: 10.1049/ipr2.13190 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 26.07.2024. Verfasst von Jiajun Huang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: HORIZON EUROPE Marie Sklodowska-Curie Actions.
Abstract (Originalsprache)
The authors propose Point'n Move, a method that achieves interactive scene object manipulation with exposed region inpainting. Interactivity here further comes from intuitive object selection and real‐time editing. To achieve this, Gaussian Splatting Radiance Field is adopted as the scene representation and its explicit nature and speed advantage are fully leveraged. Its explicit representation formulation allows to devise a 2D prompt points to 3D masks dual‐stage self‐prompting segmentation algorithm, perform mask refinement and merging, minimize changes, and provide good initialization for scene inpainting and perform editing in real‐time without per‐editing training; all lead to superior quality and performance. The method was tested by editing both forward‐facing and 360 scenes. The method is also compared against existing methods, showing superior quality despite being more capable and having a speed advantage.
Förderung
- HORIZON EUROPE Marie Sklodowska-Curie Actions
Zitieren
APA
Huang, J., Yu, H., Zhang, J., & Nait‐Charif, H. (2024). Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields. IET Image Processing, 18(12), 3507-3517. https://doi.org/10.1049/ipr2.13190
Vancouver
Huang J, Yu H, Zhang J, Nait‐Charif H. Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields. IET Image Processing. 2024;18(12):3507-3517. doi:10.1049/ipr2.13190
BibTeX
@article{Huang2024,
author = {Huang, Jiajun and Yu, Hongchuan and Zhang, Jianjun and Nait‐Charif, Hammadi},
title = {Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields},
journal = {IET Image Processing},
year = {2024},
volume = {18},
number = {12},
pages = {3507--3517},
doi = {10.1049/ipr2.13190}
}
EUVIMED