EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

3D Reconstruction with Fast Dipole Sums

Hanyu Chen, Bailey Miller, Ioannis Gkioulekas

ACM Transactions on Graphics · 19.12.2024 · 43 (6) · 1-19

DOI: 10.1145/3687914 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 19.11.2024. Verfasst von Hanyu Chen und 2 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 106 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation, National Institute of Food and Agriculture, Alfred P. Sloan Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We introduce a method for high-quality 3D reconstruction from multi-view images. Our method uses a new point-based representation, the regularized dipole sum, which generalizes the winding number to allow for interpolation of per-point attributes in point clouds with noisy or outlier points. Using regularized dipole sums, we represent implicit geometry and radiance fields as per-point attributes of a dense point cloud, which we initialize from structure from motion. We additionally derive Barnes-Hut fast summation schemes for accelerated forward and adjoint dipole sum queries. These queries facilitate the use of ray tracing to efficiently and differentiably render images with our point-based representations, and thus update their point attributes to optimize scene geometry and appearance. We evaluate our method in inverse rendering applications against state-of-the-art alternatives, based on ray tracing of neural representations or rasterization of Gaussian point-based representations. Our method significantly improves 3D reconstruction quality and robustness at equal runtimes, while also supporting more general rendering methods such as shadow rays for direct illumination.

Förderung

  • National Science Foundation
  • National Institute of Food and Agriculture
  • Alfred P. Sloan Foundation

Zitieren

APA

Chen, H., Miller, B., & Gkioulekas, I. (2024). 3D Reconstruction with Fast Dipole Sums. ACM Transactions on Graphics, 43(6), 1-19. https://doi.org/10.1145/3687914

Vancouver

Chen H, Miller B, Gkioulekas I. 3D Reconstruction with Fast Dipole Sums. ACM Transactions on Graphics. 2024;43(6):1-19. doi:10.1145/3687914

BibTeX
@article{Chen2024,
  author = {Chen, Hanyu and Miller, Bailey and Gkioulekas, Ioannis},
  title = {3D Reconstruction with Fast Dipole Sums},
  journal = {ACM Transactions on Graphics},
  year = {2024},
  volume = {43},
  number = {6},
  pages = {1--19},
  doi = {10.1145/3687914}
}
Kostenlos starten →