SEG-SLAM: Dynamic Indoor RGB-D Visual SLAM Integrating Geometric and YOLOv5-Based Semantic Information
Sensors · 25.03.2024 · 24 (7) · 2102
DOI: 10.3390/s24072102 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 25.03.2024. Verfasst von Peichao Cong und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical and Automotive Engineering, Guangxi University of Science and Technology, Liuzhou 545006, China. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Peichao Cong, Central Government Guides Local Science and Technology Development Foundation Projects, Guangxi Key Research and Development Project.
Abstract (Originalsprache)
Simultaneous localisation and mapping (SLAM) is crucial in mobile robotics. Most visual SLAM systems assume that the environment is static. However, in real life, there are many dynamic objects, which affect the accuracy and robustness of these systems. To improve the performance of visual SLAM systems, this study proposes a dynamic visual SLAM (SEG-SLAM) system based on the orientated FAST and rotated BRIEF (ORB)-SLAM3 framework and you only look once (YOLO)v5 deep-learning method. First, based on the ORB-SLAM3 framework, the YOLOv5 deep-learning method is used to construct a fusion module for target detection and semantic segmentation. This module can effectively identify and extract prior information for obviously and potentially dynamic objects. Second, differentiated dynamic feature point rejection strategies are developed for different dynamic objects using the prior information, depth information, and epipolar geometry method. Thus, the localisation and mapping accuracy of the SEG-SLAM system is improved. Finally, the rejection results are fused with the depth information, and a static dense 3D mapping without dynamic objects is constructed using the Point Cloud Library. The SEG-SLAM system is evaluated using public TUM datasets and real-world scenarios. The proposed method is more accurate and robust than current dynamic visual SLAM algorithms.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechanical and Automotive Engineering, Guangxi University of Science and Technology, Liuzhou 545006, China.
ORCID-Profile: Yixuan Xiao
Förderung
- Peichao Cong
- Central Government Guides Local Science and Technology Development Foundation Projects
- Guangxi Key Research and Development Project
Zitieren
APA
Cong, P., Li, J., Liu, J., Xiao, Y., & Zhang, X. (2024). SEG-SLAM: Dynamic Indoor RGB-D Visual SLAM Integrating Geometric and YOLOv5-Based Semantic Information. Sensors, 24(7), 2102. https://doi.org/10.3390/s24072102
Vancouver
Cong P, Li J, Liu J, Xiao Y, Zhang X. SEG-SLAM: Dynamic Indoor RGB-D Visual SLAM Integrating Geometric and YOLOv5-Based Semantic Information. Sensors. 2024;24(7):2102. doi:10.3390/s24072102
BibTeX
@article{Cong2024,
author = {Cong, Peichao and Li, Jiaxing and Liu, Junjie and Xiao, Yixuan and Zhang, Xin},
title = {SEG-SLAM: Dynamic Indoor RGB-D Visual SLAM Integrating Geometric and YOLOv5-Based Semantic Information},
journal = {Sensors},
year = {2024},
volume = {24},
number = {7},
pages = {2102},
doi = {10.3390/s24072102}
}
EUVIMED