EUVIMEDScopri EUVIMED
Open access · CC BY 4.0

Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields

Jiajun Huang, Hongchuan Yu, Jianjun Zhang, Hammadi Nait‐Charif

IET Image Processing · 2024-10 · 18 (12) · 3507-3517

DOI: 10.1049/ipr2.13190 ↗

At a glance

Journal article in IET Image Processing, published online on 2024-07-26. Written by Jiajun Huang and 3 co-authors. Cited 30 times so far (Crossref); 28 references. The full text is freely available (open access, CC BY 4.0). Funded by: HORIZON EUROPE Marie Sklodowska-Curie Actions.

AbstractDati bibliograficiCiteRelated studies

Abstract (original language)

The authors propose Point'n Move, a method that achieves interactive scene object manipulation with exposed region inpainting. Interactivity here further comes from intuitive object selection and real‐time editing. To achieve this, Gaussian Splatting Radiance Field is adopted as the scene representation and its explicit nature and speed advantage are fully leveraged. Its explicit representation formulation allows to devise a 2D prompt points to 3D masks dual‐stage self‐prompting segmentation algorithm, perform mask refinement and merging, minimize changes, and provide good initialization for scene inpainting and perform editing in real‐time without per‐editing training; all lead to superior quality and performance. The method was tested by editing both forward‐facing and 360 scenes. The method is also compared against existing methods, showing superior quality despite being more capable and having a speed advantage.

Funding

  • HORIZON EUROPE Marie Sklodowska-Curie Actions

Cite

APA

Huang, J., Yu, H., Zhang, J., & Nait‐Charif, H. (2024). Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields. IET Image Processing, 18(12), 3507-3517. https://doi.org/10.1049/ipr2.13190

Vancouver

Huang J, Yu H, Zhang J, Nait‐Charif H. Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields. IET Image Processing. 2024;18(12):3507-3517. doi:10.1049/ipr2.13190

BibTeX
@article{Huang2024,
  author = {Huang, Jiajun and Yu, Hongchuan and Zhang, Jianjun and Nait‐Charif, Hammadi},
  title = {Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields},
  journal = {IET Image Processing},
  year = {2024},
  volume = {18},
  number = {12},
  pages = {3507--3517},
  doi = {10.1049/ipr2.13190}
}
Start for free →