Investigating Prior-Level Fusion Approaches for Enriched Semantic Segmentation of Urban LiDAR Point Clouds
Remote Sensing · 13.01.2024 · 16 (2) · 329
DOI: 10.3390/rs16020329 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 13.01.2024. Verfasst von Zouhair Ballouch und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Three-dimensional semantic segmentation is the foundation for automatically creating enriched Digital Twin Cities (DTCs) and their updates. For this task, prior-level fusion approaches show more promising results than other fusion levels. This article proposes a new approach by developing and benchmarking three prior-level fusion scenarios to enhance the outcomes of point cloud-enriched semantic segmentation. The latter were compared with a baseline approach that used the point cloud only. In each scenario, specific prior knowledge (geometric features, classified images, or classified geometric information) and aerial images were fused into the neural network’s learning pipeline with the point cloud data. The goal was to identify the one that most profoundly enhanced the neural network’s knowledge. Two deep learning techniques, “RandLaNet” and “KPConv”, were adopted, and their parameters were modified for different scenarios. Efficient feature engineering and selection for the fusion step facilitated the learning process and improved the semantic segmentation results. Our contribution provides a good solution for addressing some challenges, particularly for more accurate extraction of semantically rich objects from the urban environment. The experimental results have demonstrated that Scenario 1 has higher precision (88%) on the SensatUrban dataset compared to the baseline approach (71%), the Scenario 2 approach (85%), and the Scenario 3 approach (84%). Furthermore, the qualitative results obtained by the first scenario are close to the ground truth. Therefore, it was identified as the efficient fusion approach for point cloud-enriched semantic segmentation, which we have named the efficient prior-level fusion (Efficient-PLF) approach.
Zitieren
APA
Ballouch, Z., Hajji, R., Kharroubi, A., Poux, F., & Billen, R. (2024). Investigating Prior-Level Fusion Approaches for Enriched Semantic Segmentation of Urban LiDAR Point Clouds. Remote Sensing, 16(2), 329. https://doi.org/10.3390/rs16020329
Vancouver
Ballouch Z, Hajji R, Kharroubi A, Poux F, Billen R. Investigating Prior-Level Fusion Approaches for Enriched Semantic Segmentation of Urban LiDAR Point Clouds. Remote Sensing. 2024;16(2):329. doi:10.3390/rs16020329
BibTeX
@article{Ballouch2024,
author = {Ballouch, Zouhair and Hajji, Rafika and Kharroubi, Abderrazzaq and Poux, Florent and Billen, Roland},
title = {Investigating Prior-Level Fusion Approaches for Enriched Semantic Segmentation of Urban LiDAR Point Clouds},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {2},
pages = {329},
doi = {10.3390/rs16020329}
}
EUVIMED