MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes
ACM Transactions on Graphics · 2023-08 · 42 (4) · 1-12
DOI: 10.1145/3592426 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 26.07.2023. Verfasst von Christian Reiser und 7 weiteren Autor:innen. Die Arbeit wurde bisher 214-mal zitiert (Crossref) und nennt 67 Literaturangaben. Gefördert von: ERC Starting Grant LEGO3D, DFG EXC number.
Abstract (Originalsprache)
Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We present a Memory-Efficient Radiance Field (MERF) representation that achieves real-time rendering of large-scale scenes in a browser. MERF reduces the memory consumption of prior sparse volumetric radiance fields using a combination of a sparse feature grid and high-resolution 2D feature planes. To support large-scale unbounded scenes, we introduce a novel contraction function that maps scene coordinates into a bounded volume while still allowing for efficient ray-box intersection. We design a lossless procedure for baking the parameterization used during training into a model that achieves real-time rendering while still preserving the photorealistic view synthesis quality of a volumetric radiance field.
Förderung
- ERC Starting Grant LEGO3D
- DFG EXC number
Zitieren
APA
Reiser, C., Szeliski, R., Verbin, D., Srinivasan, P., Mildenhall, B., Geiger, A., Barron, J., & Hedman, P. (2023). MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes. ACM Transactions on Graphics, 42(4), 1-12. https://doi.org/10.1145/3592426
Vancouver
Reiser C, Szeliski R, Verbin D, Srinivasan P, Mildenhall B, Geiger A, et al. MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes. ACM Transactions on Graphics. 2023;42(4):1-12. doi:10.1145/3592426
BibTeX
@article{Reiser2023,
author = {Reiser, Christian and Szeliski, Rick and Verbin, Dor and Srinivasan, Pratul and Mildenhall, Ben and Geiger, Andreas and Barron, Jon and Hedman, Peter},
title = {MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes},
journal = {ACM Transactions on Graphics},
year = {2023},
volume = {42},
number = {4},
pages = {1--12},
doi = {10.1145/3592426}
}
EUVIMED