3D Reconstruction with Fast Dipole Sums
ACM Transactions on Graphics · 19.12.2024 · 43 (6) · 1-19
DOI: 10.1145/3687914 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 19.11.2024. Verfasst von Hanyu Chen und 2 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 106 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation, National Institute of Food and Agriculture, Alfred P. Sloan Foundation.
Abstract (Originalsprache)
We introduce a method for high-quality 3D reconstruction from multi-view images. Our method uses a new point-based representation, the regularized dipole sum, which generalizes the winding number to allow for interpolation of per-point attributes in point clouds with noisy or outlier points. Using regularized dipole sums, we represent implicit geometry and radiance fields as per-point attributes of a dense point cloud, which we initialize from structure from motion. We additionally derive Barnes-Hut fast summation schemes for accelerated forward and adjoint dipole sum queries. These queries facilitate the use of ray tracing to efficiently and differentiably render images with our point-based representations, and thus update their point attributes to optimize scene geometry and appearance. We evaluate our method in inverse rendering applications against state-of-the-art alternatives, based on ray tracing of neural representations or rasterization of Gaussian point-based representations. Our method significantly improves 3D reconstruction quality and robustness at equal runtimes, while also supporting more general rendering methods such as shadow rays for direct illumination.
Förderung
- National Science Foundation
- National Institute of Food and Agriculture
- Alfred P. Sloan Foundation
Zitieren
APA
Chen, H., Miller, B., & Gkioulekas, I. (2024). 3D Reconstruction with Fast Dipole Sums. ACM Transactions on Graphics, 43(6), 1-19. https://doi.org/10.1145/3687914
Vancouver
Chen H, Miller B, Gkioulekas I. 3D Reconstruction with Fast Dipole Sums. ACM Transactions on Graphics. 2024;43(6):1-19. doi:10.1145/3687914
BibTeX
@article{Chen2024,
author = {Chen, Hanyu and Miller, Bailey and Gkioulekas, Ioannis},
title = {3D Reconstruction with Fast Dipole Sums},
journal = {ACM Transactions on Graphics},
year = {2024},
volume = {43},
number = {6},
pages = {1--19},
doi = {10.1145/3687914}
}
EUVIMED