StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023-12 · 45 (12) · 15694-15705
DOI: 10.1109/tpami.2023.3305295 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023-12. Verfasst von Zheng Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology.
Abstract (Originalsprache)
Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view synthesis quality. Inspired by self-supervised depth estimation methods, we propose StructNeRF, a solution to novel view synthesis for indoor scenes with sparse inputs. StructNeRF leverages the structural hints naturally embedded in multi-view inputs to handle the unconstrained geometry issue in NeRF. Specifically, it tackles the texture and non-texture regions respectively: a patch-based multi-view consistent photometric loss is proposed to constrain the geometry of textured regions; for non-textured ones, we explicitly restrict them to be 3D consistent planes. Through the dense self-supervised depth constraints, our method improves both the geometry and the view synthesis performance of NeRF without any additional training on external data. Extensive experiments on several real-world datasets demonstrate that StructNeRF shows superior or comparable performance compared to state-of-the-art methods (e.g. NeRF, DSNeRF, RegNeRF, Dense Depth Priors, MonoSDF, etc.) for indoor scenes with sparse inputs both quantitatively and qualitatively.
Förderung
- National Natural Science Foundation of China
- Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology
Zitieren
APA
Chen, Z., Wang, C., Guo, Y. C., & Zhang, S. H. (2023). StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(12), 15694-15705. https://doi.org/10.1109/tpami.2023.3305295
Vancouver
Chen Z, Wang C, Guo YC, Zhang SH. StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(12):15694-15705. doi:10.1109/tpami.2023.3305295
BibTeX
@article{Chen2023,
author = {Chen, Zheng and Wang, Chen and Guo, Yuan-Chen and Zhang, Song-Hai},
title = {StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {12},
pages = {15694--15705},
doi = {10.1109/tpami.2023.3305295}
}
EUVIMED