Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data
Sensors · 24.10.2024 · 24 (21) · 6823
DOI: 10.3390/s24216823 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 24.10.2024. Verfasst von Udaka A Manawadu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Computer Science and Engineering, University of Aizu, Aizu-Wakamatsu, Fukushima 965-0006, Japan. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: F-REI.
Abstract (Originalsprache)
This study presents an integrated system for object recognition, six-degrees-of-freedom pose estimation, and dexterous manipulation using a JACO robotic arm with an Intel RealSense D435 camera. This system is designed to automate the manipulation of industrial valves by capturing point clouds (PCs) from multiple perspectives to improve the accuracy of pose estimation. The object recognition module includes scene segmentation, geometric primitives recognition, model recognition, and a color-based clustering and integration approach enhanced by a dynamic cluster merging algorithm. Pose estimation is achieved using the random sample consensus algorithm, which predicts position and orientation. The system was tested within a 60° field of view, which extended in all directions in front of the object. The experimental results show that the system performs reliably within acceptable error thresholds for both position and orientation when the objects are within a ±15° range of the camera’s direct view. However, errors increased with more extreme object orientations and distances, particularly when estimating the orientation of ball valves. A zone-based dexterous manipulation strategy was developed to overcome these challenges, where the system adjusts the camera position for optimal conditions. This approach mitigates larger errors in difficult scenarios, enhancing overall system reliability. The key contributions of this research include a novel method for improving object recognition and pose estimation, a technique for increasing the accuracy of pose estimation, and the development of a robot motion model for dexterous manipulation in industrial settings.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Computer Science and Engineering, University of Aizu, Aizu-Wakamatsu, Fukushima 965-0006, Japan.
ORCID-Profile: Udaka A Manawadu, Naruse Keitaro
Förderung
- F-REI
Zitieren
APA
Manawadu, U. A., & Keitaro, N. (2024). Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data. Sensors, 24(21), 6823. https://doi.org/10.3390/s24216823
Vancouver
Manawadu UA, Keitaro N. Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data. Sensors. 2024;24(21):6823. doi:10.3390/s24216823
BibTeX
@article{Manawadu2024,
author = {Manawadu, Udaka A and Keitaro, Naruse},
title = {Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data},
journal = {Sensors},
year = {2024},
volume = {24},
number = {21},
pages = {6823},
doi = {10.3390/s24216823}
}
EUVIMED