EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SEG-SLAM: Dynamic Indoor RGB-D Visual SLAM Integrating Geometric and YOLOv5-Based Semantic Information

Peichao Cong, Jiaxing Li, Junjie Liu, Yixuan Xiao iD, Xin Zhang

Sensors · 25.03.2024 · 24 (7) · 2102

DOI: 10.3390/s24072102 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 25.03.2024. Verfasst von Peichao Cong und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical and Automotive Engineering, Guangxi University of Science and Technology, Liuzhou 545006, China. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Peichao Cong, Central Government Guides Local Science and Technology Development Foundation Projects, Guangxi Key Research and Development Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Simultaneous localisation and mapping (SLAM) is crucial in mobile robotics. Most visual SLAM systems assume that the environment is static. However, in real life, there are many dynamic objects, which affect the accuracy and robustness of these systems. To improve the performance of visual SLAM systems, this study proposes a dynamic visual SLAM (SEG-SLAM) system based on the orientated FAST and rotated BRIEF (ORB)-SLAM3 framework and you only look once (YOLO)v5 deep-learning method. First, based on the ORB-SLAM3 framework, the YOLOv5 deep-learning method is used to construct a fusion module for target detection and semantic segmentation. This module can effectively identify and extract prior information for obviously and potentially dynamic objects. Second, differentiated dynamic feature point rejection strategies are developed for different dynamic objects using the prior information, depth information, and epipolar geometry method. Thus, the localisation and mapping accuracy of the SEG-SLAM system is improved. Finally, the rejection results are fused with the depth information, and a static dense 3D mapping without dynamic objects is constructed using the Point Cloud Library. The SEG-SLAM system is evaluated using public TUM datasets and real-world scenarios. The proposed method is more accurate and robust than current dynamic visual SLAM algorithms.

Schlagwörter

Stichwörter der Autor:innen

RGB-D VSLAMYOLOv5dynamic environmentssemantic segmentation

Autor:innen und Institutionen

  • School of Mechanical and Automotive Engineering, Guangxi University of Science and Technology, Liuzhou 545006, China.

ORCID-Profile: Yixuan Xiao

Förderung

  • Peichao Cong
  • Central Government Guides Local Science and Technology Development Foundation Projects
  • Guangxi Key Research and Development Project

Zitieren

APA

Cong, P., Li, J., Liu, J., Xiao, Y., & Zhang, X. (2024). SEG-SLAM: Dynamic Indoor RGB-D Visual SLAM Integrating Geometric and YOLOv5-Based Semantic Information. Sensors, 24(7), 2102. https://doi.org/10.3390/s24072102

Vancouver

Cong P, Li J, Liu J, Xiao Y, Zhang X. SEG-SLAM: Dynamic Indoor RGB-D Visual SLAM Integrating Geometric and YOLOv5-Based Semantic Information. Sensors. 2024;24(7):2102. doi:10.3390/s24072102

BibTeX
@article{Cong2024,
  author = {Cong, Peichao and Li, Jiaxing and Liu, Junjie and Xiao, Yixuan and Zhang, Xin},
  title = {SEG-SLAM: Dynamic Indoor RGB-D Visual SLAM Integrating Geometric and YOLOv5-Based Semantic Information},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {7},
  pages = {2102},
  doi = {10.3390/s24072102}
}
Kostenlos starten →