EUVIMEDEUVIMED entdecken
Crossref

3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting

Xiaoyang Lyu, Yang-Tian Sun, Yi-Hua Huang, Xiuzhe Wu, Ziyi Yang, Yilun Chen, Jiangmiao Pang, Xiaojuan Qi

ACM Transactions on Graphics · 19.12.2024 · 43 (6) · 1-12

DOI: 10.1145/3687952 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 19.11.2024. Verfasst von Xiaoyang Lyu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 81-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: Hong Kong Research Grant Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we present an implicit surface reconstruction method with 3D Gaussian Splatting (3DGS), namely 3DGSR, that allows for accurate 3D reconstruction with intricate details while inheriting the high efficiency and rendering quality of 3DGS. The key insight is to incorporate an implicit signed distance field (SDF) within 3D Gaussians for surface modeling, and to enable the alignment and joint optimization of both SDF and 3D Gaussians. To achieve this, we design coupling strategies that align and associate the SDF with 3D Gaussians, allowing for unified optimization and enforcing surface constraints on the 3D Gaussians. With alignment, optimizing the 3D Gaussians provides supervisory signals for SDF learning, enabling the reconstruction of intricate details. However, this only offers sparse supervisory signals to the SDF at locations occupied by Gaussians, which is insufficient for learning a continuous SDF. Then, to address this limitation, we incorporate volumetric rendering and align the rendered geometric attributes (depth, normal) with that derived from 3DGS. In sum, these two designs allow SDF and 3DGS to be aligned, jointly optimized, and mutually boosted. Our extensive experimental results demonstrate that our 3DGSR enables high-quality 3D surface reconstruction while preserving the efficiency and rendering quality of 3DGS. Besides, our method competes favorably with leading surface reconstruction techniques while offering a more efficient learning process and much better rendering qualities.

Förderung

  • Hong Kong Research Grant Council

Zitieren

APA

Lyu, X., Sun, Y., Huang, Y., Wu, X., Yang, Z., Chen, Y., Pang, J., & Qi, X. (2024). 3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting. ACM Transactions on Graphics, 43(6), 1-12. https://doi.org/10.1145/3687952

Vancouver

Lyu X, Sun Y, Huang Y, Wu X, Yang Z, Chen Y, et al. 3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting. ACM Transactions on Graphics. 2024;43(6):1-12. doi:10.1145/3687952

BibTeX
@article{Lyu2024,
  author = {Lyu, Xiaoyang and Sun, Yang-Tian and Huang, Yi-Hua and Wu, Xiuzhe and Yang, Ziyi and Chen, Yilun and Pang, Jiangmiao and Qi, Xiaojuan},
  title = {3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting},
  journal = {ACM Transactions on Graphics},
  year = {2024},
  volume = {43},
  number = {6},
  pages = {1--12},
  doi = {10.1145/3687952}
}
Kostenlos starten →