DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow
Sensors · 12.09.2024 · 24 (18) · 5929
DOI: 10.3390/s24185929 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 12.09.2024. Verfasst von Lang He und 3 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Kunming 650500, China. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Feature points from moving objects can negatively impact the accuracy of Visual Simultaneous Localization and Mapping (VSLAM) algorithms, while detection or semantic segmentation-based VSLAM approaches often fail to accurately determine the true motion state of objects. To address this challenge, this paper introduces DIO-SLAM: Dynamic Instance Optical Flow SLAM, a VSLAM system specifically designed for dynamic environments. Initially, the detection thread employs YOLACT (You Only Look At CoefficienTs) to distinguish between rigid and non-rigid objects within the scene. Subsequently, the optical flow thread estimates optical flow and introduces a novel approach to capture the optical flow of moving objects by leveraging optical flow residuals. Following this, an optical flow consistency method is implemented to assess the dynamic nature of rigid object mask regions, classifying them as either moving or stationary rigid objects. To mitigate errors caused by missed detections or motion blur, a motion frame propagation method is employed. Lastly, a dense mapping thread is incorporated to filter out non-rigid objects using semantic information, track the point clouds of rigid objects, reconstruct the static background, and store the resulting map in an octree format. Experimental results demonstrate that the proposed method surpasses current mainstream dynamic VSLAM techniques in both localization accuracy and real-time performance.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Kunming 650500, China.
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310014, China.
ORCID-Profile: Lang He
Zitieren
APA
He, L., Li, S., Qiu, J., & Zhang, C. (2024). DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow. Sensors, 24(18), 5929. https://doi.org/10.3390/s24185929
Vancouver
He L, Li S, Qiu J, Zhang C. DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow. Sensors. 2024;24(18):5929. doi:10.3390/s24185929
BibTeX
@article{He2024,
author = {He, Lang and Li, Shiyun and Qiu, Junting and Zhang, Chenhaomin},
title = {DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow},
journal = {Sensors},
year = {2024},
volume = {24},
number = {18},
pages = {5929},
doi = {10.3390/s24185929}
}
EUVIMED