Automatic Removal of Non-Architectural Elements in 3D Models of Historic Buildings with Language Embedded Radiance Fields
Heritage · 18.06.2024 · 7 (6) · 3332-3349
DOI: 10.3390/heritage7060157 ↗Kurz gefasst
Fachartikel in der Zeitschrift Heritage, online erschienen am 18.06.2024. Verfasst von Alexander Rusnak und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: EPFL Center for Imaging.
Abstract (Originalsprache)
Neural radiance fields have emerged as a dominant paradigm for creating complex 3D environments incorporating synthetic novel views. However, 3D object removal applications utilizing neural radiance fields have lagged behind in effectiveness, particularly when open set queries are necessary for determining the relevant objects. One such application area is in architectural heritage preservation, where the automatic removal of non-architectural objects from 3D environments is necessary for many downstream tasks. Furthermore, when modeling occupied buildings, it is crucial for modeling techniques to be privacy preserving by default; this also motivates the removal of non-architectural elements. In this paper, we propose a pipeline for the automatic creation of cleaned, architectural structure only point clouds utilizing a language embedded radiance field (LERF) with a specific application toward generating suitable point clouds for the structural integrity assessment of occupied buildings. We then validated the efficacy of our approach on the rooms of the historic Sion hospital, a national historic monument in Valais, Switzerland. By using our automatic removal pipeline on the point clouds of rooms filled with furniture, we decreased the average earth mover’s distance (EMD) to the ground truth point clouds of the physically emptied rooms by 31 percent. The success of our research points the way toward new paradigms in architectural modeling and cultural preservation.
Förderung
- EPFL Center for Imaging
Zitieren
APA
Rusnak, A., Pantoja-Rosero, B. G., Kaplan, F., & Beyer, K. (2024). Automatic Removal of Non-Architectural Elements in 3D Models of Historic Buildings with Language Embedded Radiance Fields. Heritage, 7(6), 3332-3349. https://doi.org/10.3390/heritage7060157
Vancouver
Rusnak A, Pantoja-Rosero BG, Kaplan F, Beyer K. Automatic Removal of Non-Architectural Elements in 3D Models of Historic Buildings with Language Embedded Radiance Fields. Heritage. 2024;7(6):3332-3349. doi:10.3390/heritage7060157
BibTeX
@article{Rusnak2024,
author = {Rusnak, Alexander and Pantoja-Rosero, Bryan G. and Kaplan, Frédéric and Beyer, Katrin},
title = {Automatic Removal of Non-Architectural Elements in 3D Models of Historic Buildings with Language Embedded Radiance Fields},
journal = {Heritage},
year = {2024},
volume = {7},
number = {6},
pages = {3332--3349},
doi = {10.3390/heritage7060157}
}
EUVIMED