3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting
ACM Transactions on Graphics · 19.12.2024 · 43 (6) · 1-12
DOI: 10.1145/3687952 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 19.11.2024. Verfasst von Xiaoyang Lyu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 81-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: Hong Kong Research Grant Council.
Abstract (Originalsprache)
In this paper, we present an implicit surface reconstruction method with 3D Gaussian Splatting (3DGS), namely 3DGSR, that allows for accurate 3D reconstruction with intricate details while inheriting the high efficiency and rendering quality of 3DGS. The key insight is to incorporate an implicit signed distance field (SDF) within 3D Gaussians for surface modeling, and to enable the alignment and joint optimization of both SDF and 3D Gaussians. To achieve this, we design coupling strategies that align and associate the SDF with 3D Gaussians, allowing for unified optimization and enforcing surface constraints on the 3D Gaussians. With alignment, optimizing the 3D Gaussians provides supervisory signals for SDF learning, enabling the reconstruction of intricate details. However, this only offers sparse supervisory signals to the SDF at locations occupied by Gaussians, which is insufficient for learning a continuous SDF. Then, to address this limitation, we incorporate volumetric rendering and align the rendered geometric attributes (depth, normal) with that derived from 3DGS. In sum, these two designs allow SDF and 3DGS to be aligned, jointly optimized, and mutually boosted. Our extensive experimental results demonstrate that our 3DGSR enables high-quality 3D surface reconstruction while preserving the efficiency and rendering quality of 3DGS. Besides, our method competes favorably with leading surface reconstruction techniques while offering a more efficient learning process and much better rendering qualities.
Förderung
- Hong Kong Research Grant Council
Zitieren
APA
Lyu, X., Sun, Y., Huang, Y., Wu, X., Yang, Z., Chen, Y., Pang, J., & Qi, X. (2024). 3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting. ACM Transactions on Graphics, 43(6), 1-12. https://doi.org/10.1145/3687952
Vancouver
Lyu X, Sun Y, Huang Y, Wu X, Yang Z, Chen Y, et al. 3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting. ACM Transactions on Graphics. 2024;43(6):1-12. doi:10.1145/3687952
BibTeX
@article{Lyu2024,
author = {Lyu, Xiaoyang and Sun, Yang-Tian and Huang, Yi-Hua and Wu, Xiuzhe and Yang, Ziyi and Chen, Yilun and Pang, Jiangmiao and Qi, Xiaojuan},
title = {3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting},
journal = {ACM Transactions on Graphics},
year = {2024},
volume = {43},
number = {6},
pages = {1--12},
doi = {10.1145/3687952}
}
EUVIMED