EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow

Lang He iD, Shiyun Li, Junting Qiu, Chenhaomin Zhang

Sensors · 12.09.2024 · 24 (18) · 5929

DOI: 10.3390/s24185929 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 12.09.2024. Verfasst von Lang He und 3 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Kunming 650500, China. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Feature points from moving objects can negatively impact the accuracy of Visual Simultaneous Localization and Mapping (VSLAM) algorithms, while detection or semantic segmentation-based VSLAM approaches often fail to accurately determine the true motion state of objects. To address this challenge, this paper introduces DIO-SLAM: Dynamic Instance Optical Flow SLAM, a VSLAM system specifically designed for dynamic environments. Initially, the detection thread employs YOLACT (You Only Look At CoefficienTs) to distinguish between rigid and non-rigid objects within the scene. Subsequently, the optical flow thread estimates optical flow and introduces a novel approach to capture the optical flow of moving objects by leveraging optical flow residuals. Following this, an optical flow consistency method is implemented to assess the dynamic nature of rigid object mask regions, classifying them as either moving or stationary rigid objects. To mitigate errors caused by missed detections or motion blur, a motion frame propagation method is employed. Lastly, a dense mapping thread is incorporated to filter out non-rigid objects using semantic information, track the point clouds of rigid objects, reconstruct the static background, and store the resulting map in an octree format. Experimental results demonstrate that the proposed method surpasses current mainstream dynamic VSLAM techniques in both localization accuracy and real-time performance.

Schlagwörter

Stichwörter der Autor:innen

dense optical flowdynamic SLAMdynamic feature point removalinstance segmentationoctreepoint cloud reconstruction

Autor:innen und Institutionen

  • Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Kunming 650500, China.
  • College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310014, China.

ORCID-Profile: Lang He

Zitieren

APA

He, L., Li, S., Qiu, J., & Zhang, C. (2024). DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow. Sensors, 24(18), 5929. https://doi.org/10.3390/s24185929

Vancouver

He L, Li S, Qiu J, Zhang C. DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow. Sensors. 2024;24(18):5929. doi:10.3390/s24185929

BibTeX
@article{He2024,
  author = {He, Lang and Li, Shiyun and Qiu, Junting and Zhang, Chenhaomin},
  title = {DIO-SLAM: A Dynamic RGB-D SLAM Method Combining Instance Segmentation and Optical Flow},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {18},
  pages = {5929},
  doi = {10.3390/s24185929}
}
Kostenlos starten →