Unmanned Aerial Vehicle-Neural Radiance Field (UAV-NeRF): Learning Multiview Drone Three-Dimensional Reconstruction with Neural Radiance Field
Remote Sensing · 08.11.2024 · 16 (22) · 4168
DOI: 10.3390/rs16224168 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 08.11.2024. Verfasst von Li Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Program of Song Shan Laboratory (included in the management of Major Science and Technology of Henan Province).
Abstract (Originalsprache)
In traditional 3D reconstruction using UAV images, only radiance information, which is treated as a geometric constraint, is used in feature matching, allowing for the restoration of the scene’s structure. After introducing radiance supervision, NeRF can adjust the geometry in the fixed-ray direction, resulting in a smaller search space and higher robustness. Considering the lack of NeRF construction methods for aerial scenarios, we propose a new NeRF point sampling method, which is generated using a UAV imaging model, compatible with a global geographic coordinate system, and suitable for a UAV view. We found that NeRF is optimized entirely based on the radiance while ignoring the direct geometry constraint. Therefore, we designed a radiance correction strategy that considers the incidence angle. Our method can complete point sampling in a UAV imaging scene, as well as simultaneously perform digital surface model construction and ground radiance information recovery. When tested on self-acquired datasets, the NeRF variant proposed in this paper achieved better reconstruction accuracy than the original NeRF-based methods. It also reached a level of precision comparable to that of traditional photogrammetry methods, and it is capable of outputting a surface albedo that includes shadow information.
Förderung
- National Natural Science Foundation of China
- Program of Song Shan Laboratory (included in the management of Major Science and Technology of Henan Province)
Zitieren
APA
Li, L., Zhang, Y., Jiang, Z., Wang, Z., Zhang, L., & Gao, H. (2024). Unmanned Aerial Vehicle-Neural Radiance Field (UAV-NeRF): Learning Multiview Drone Three-Dimensional Reconstruction with Neural Radiance Field. Remote Sensing, 16(22), 4168. https://doi.org/10.3390/rs16224168
Vancouver
Li L, Zhang Y, Jiang Z, Wang Z, Zhang L, Gao H. Unmanned Aerial Vehicle-Neural Radiance Field (UAV-NeRF): Learning Multiview Drone Three-Dimensional Reconstruction with Neural Radiance Field. Remote Sensing. 2024;16(22):4168. doi:10.3390/rs16224168
BibTeX
@article{Li2024,
author = {Li, Li and Zhang, Yongsheng and Jiang, Zhipeng and Wang, Ziquan and Zhang, Lei and Gao, Han},
title = {Unmanned Aerial Vehicle-Neural Radiance Field (UAV-NeRF): Learning Multiview Drone Three-Dimensional Reconstruction with Neural Radiance Field},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {22},
pages = {4168},
doi = {10.3390/rs16224168}
}
EUVIMED