Global Semantic Localization from Abstract Ellipse-Ellipsoid Model and Object-Level Instance Topology
Remote Sensing · 10.11.2024 · 16 (22) · 4187
DOI: 10.3390/rs16224187 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 10.11.2024. Verfasst von Heng Wu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Special Projects of Heilongjiang Province’s Key R&D Program, Heilongjiang Province’s Key R&D Program: ‘Leading the Charge with Open Competition’.
Abstract (Originalsprache)
Robust and highly accurate localization using a camera is a challenging task when appearance varies significantly. In indoor environments, changes in illumination and object occlusion can have a significant impact on visual localization. In this paper, we propose a visual localization method based on an ellipse-ellipsoid model, combined with object-level instance topology and alignment. First, we develop a CNN-based (Convolutional Neural Network) ellipse prediction network, DEllipse-Net, which integrates depth information with RGB data to estimate the projection of ellipsoids onto images. Second, we model environments using 3D (Three-dimensional) ellipsoids, instance topology, and ellipsoid descriptors. Finally, the detected ellipses are aligned with the ellipsoids in the environment through semantic object association, and 6-DoF (Degree of Freedom) pose estimation is performed using the ellipse-ellipsoid model. In the bounding box noise experiment, DEllipse-Net demonstrates higher robustness compared to other methods, achieving the highest prediction accuracy for 11 out of 23 objects in ellipse prediction. In the localization test with 15 pixels of noise, we achieve ATE (Absolute Translation Error) and ARE (Absolute Rotation Error) of 0.077 m and 2.70∘ in the fr2_desk sequence. Additionally, DEllipse-Net is lightweight and highly portable, with a model size of only 18.6 MB, and a single model can handle all objects. In the object-level instance topology and alignment experiment, our topology and alignment methods significantly enhance the global localization accuracy of the ellipse-ellipsoid model. In experiments involving lighting changes and occlusions, our method achieves more robust global localization compared to the classical bag-of-words based localization method and other ellipse-ellipsoid localization methods.
Förderung
- Key Special Projects of Heilongjiang Province’s Key R&D Program
- Heilongjiang Province’s Key R&D Program: ‘Leading the Charge with Open Competition’
Zitieren
APA
Wu, H., Liu, Y., Wang, C., & Wei, Y. (2024). Global Semantic Localization from Abstract Ellipse-Ellipsoid Model and Object-Level Instance Topology. Remote Sensing, 16(22), 4187. https://doi.org/10.3390/rs16224187
Vancouver
Wu H, Liu Y, Wang C, Wei Y. Global Semantic Localization from Abstract Ellipse-Ellipsoid Model and Object-Level Instance Topology. Remote Sensing. 2024;16(22):4187. doi:10.3390/rs16224187
BibTeX
@article{Wu2024,
author = {Wu, Heng and Liu, Yanjie and Wang, Chao and Wei, Yanlong},
title = {Global Semantic Localization from Abstract Ellipse-Ellipsoid Model and Object-Level Instance Topology},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {22},
pages = {4187},
doi = {10.3390/rs16224187}
}
EUVIMED