EUVIMEDEUVIMED entdecken
Crossref

StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints

Zheng Chen, Chen Wang, Yuan-Chen Guo, Song-Hai Zhang

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023-12 · 45 (12) · 15694-15705

DOI: 10.1109/tpami.2023.3305295 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023-12. Verfasst von Zheng Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view synthesis quality. Inspired by self-supervised depth estimation methods, we propose StructNeRF, a solution to novel view synthesis for indoor scenes with sparse inputs. StructNeRF leverages the structural hints naturally embedded in multi-view inputs to handle the unconstrained geometry issue in NeRF. Specifically, it tackles the texture and non-texture regions respectively: a patch-based multi-view consistent photometric loss is proposed to constrain the geometry of textured regions; for non-textured ones, we explicitly restrict them to be 3D consistent planes. Through the dense self-supervised depth constraints, our method improves both the geometry and the view synthesis performance of NeRF without any additional training on external data. Extensive experiments on several real-world datasets demonstrate that StructNeRF shows superior or comparable performance compared to state-of-the-art methods (e.g. NeRF, DSNeRF, RegNeRF, Dense Depth Priors, MonoSDF, etc.) for indoor scenes with sparse inputs both quantitatively and qualitatively.

Förderung

  • National Natural Science Foundation of China
  • Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology

Zitieren

APA

Chen, Z., Wang, C., Guo, Y. C., & Zhang, S. H. (2023). StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(12), 15694-15705. https://doi.org/10.1109/tpami.2023.3305295

Vancouver

Chen Z, Wang C, Guo YC, Zhang SH. StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(12):15694-15705. doi:10.1109/tpami.2023.3305295

BibTeX
@article{Chen2023,
  author = {Chen, Zheng and Wang, Chen and Guo, Yuan-Chen and Zhang, Song-Hai},
  title = {StructNeRF: Neural Radiance Fields for Indoor Scenes With Structural Hints},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2023},
  volume = {45},
  number = {12},
  pages = {15694--15705},
  doi = {10.1109/tpami.2023.3305295}
}
Kostenlos starten →