Reducing the Memory Footprint of 3D Gaussian Splatting
Proceedings of the ACM on Computer Graphics and Interactive Techniques · 11.05.2024 · 7 (1) · 1-17
DOI: 10.1145/3651282 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Computer Graphics and Interactive Techniques, online erschienen am 13.05.2024. Verfasst von Panagiotis Papantonakis und 4 weiteren Autor:innen. Die Arbeit wurde bisher 164-mal zitiert (Crossref) und nennt 36 Literaturangaben. Gefördert von: European Research Council.
Abstract (Originalsprache)
3D Gaussian splatting provides excellent visual quality for novel view synthesis, with fast training and realtime rendering; unfortunately, the memory requirements of this method for storing and transmission are unreasonably high. We first analyze the reasons for this, identifying three main areas where storage can be reduced: the number of 3D Gaussian primitives used to represent a scene, the number of coefficients for the spherical harmonics used to represent directional radiance, and the precision required to store Gaussian primitive attributes. We present a solution to each of these issues. First, we propose an efficient, resolution-aware primitive pruning approach, reducing the primitive count by half. Second, we introduce an adaptive adjustment method to choose the number of coefficients used to represent directional radiance for each Gaussian primitive, and finally a codebook-based quantization method, together with a half-float representation for further memory reduction. Taken together, these three components result in a x27 reduction in overall size on disk on the standard datasets we tested, along with a x1.7 speedup in rendering speed. We demonstrate our method on standard datasets and show how our solution results in significantly reduced download times when using the method on a mobile device (see Fig. 1).
Förderung
- European Research Council
Zitieren
APA
Papantonakis, P., Kopanas, G., Kerbl, B., Lanvin, A., & Drettakis, G. (2024). Reducing the Memory Footprint of 3D Gaussian Splatting. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 7(1), 1-17. https://doi.org/10.1145/3651282
Vancouver
Papantonakis P, Kopanas G, Kerbl B, Lanvin A, Drettakis G. Reducing the Memory Footprint of 3D Gaussian Splatting. Proceedings of the ACM on Computer Graphics and Interactive Techniques. 2024;7(1):1-17. doi:10.1145/3651282
BibTeX
@article{Papantonakis2024,
author = {Papantonakis, Panagiotis and Kopanas, Georgios and Kerbl, Bernhard and Lanvin, Alexandre and Drettakis, George},
title = {Reducing the Memory Footprint of 3D Gaussian Splatting},
journal = {Proceedings of the ACM on Computer Graphics and Interactive Techniques},
year = {2024},
volume = {7},
number = {1},
pages = {1--17},
doi = {10.1145/3651282}
}
EUVIMED