EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields

Jiajun Huang, Hongchuan Yu, Jianjun Zhang, Hammadi Nait‐Charif

IET Image Processing · 2024-10 · 18 (12) · 3507-3517

DOI: 10.1049/ipr2.13190 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 26.07.2024. Verfasst von Jiajun Huang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: HORIZON EUROPE Marie Sklodowska-Curie Actions.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The authors propose Point'n Move, a method that achieves interactive scene object manipulation with exposed region inpainting. Interactivity here further comes from intuitive object selection and real‐time editing. To achieve this, Gaussian Splatting Radiance Field is adopted as the scene representation and its explicit nature and speed advantage are fully leveraged. Its explicit representation formulation allows to devise a 2D prompt points to 3D masks dual‐stage self‐prompting segmentation algorithm, perform mask refinement and merging, minimize changes, and provide good initialization for scene inpainting and perform editing in real‐time without per‐editing training; all lead to superior quality and performance. The method was tested by editing both forward‐facing and 360 scenes. The method is also compared against existing methods, showing superior quality despite being more capable and having a speed advantage.

Förderung

  • HORIZON EUROPE Marie Sklodowska-Curie Actions

Zitieren

APA

Huang, J., Yu, H., Zhang, J., & Nait‐Charif, H. (2024). Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields. IET Image Processing, 18(12), 3507-3517. https://doi.org/10.1049/ipr2.13190

Vancouver

Huang J, Yu H, Zhang J, Nait‐Charif H. Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields. IET Image Processing. 2024;18(12):3507-3517. doi:10.1049/ipr2.13190

BibTeX
@article{Huang2024,
  author = {Huang, Jiajun and Yu, Hongchuan and Zhang, Jianjun and Nait‐Charif, Hammadi},
  title = {Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields},
  journal = {IET Image Processing},
  year = {2024},
  volume = {18},
  number = {12},
  pages = {3507--3517},
  doi = {10.1049/ipr2.13190}
}
Kostenlos starten →