EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data

Udaka A Manawadu iD, Naruse Keitaro iD

Sensors · 24.10.2024 · 24 (21) · 6823

DOI: 10.3390/s24216823 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 24.10.2024. Verfasst von Udaka A Manawadu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Computer Science and Engineering, University of Aizu, Aizu-Wakamatsu, Fukushima 965-0006, Japan. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: F-REI.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study presents an integrated system for object recognition, six-degrees-of-freedom pose estimation, and dexterous manipulation using a JACO robotic arm with an Intel RealSense D435 camera. This system is designed to automate the manipulation of industrial valves by capturing point clouds (PCs) from multiple perspectives to improve the accuracy of pose estimation. The object recognition module includes scene segmentation, geometric primitives recognition, model recognition, and a color-based clustering and integration approach enhanced by a dynamic cluster merging algorithm. Pose estimation is achieved using the random sample consensus algorithm, which predicts position and orientation. The system was tested within a 60° field of view, which extended in all directions in front of the object. The experimental results show that the system performs reliably within acceptable error thresholds for both position and orientation when the objects are within a ±15° range of the camera’s direct view. However, errors increased with more extreme object orientations and distances, particularly when estimating the orientation of ball valves. A zone-based dexterous manipulation strategy was developed to overcome these challenges, where the system adjusts the camera position for optimal conditions. This approach mitigates larger errors in difficult scenarios, enhancing overall system reliability. The key contributions of this research include a novel method for improving object recognition and pose estimation, a technique for increasing the accuracy of pose estimation, and the development of a robot motion model for dexterous manipulation in industrial settings.

Schlagwörter

Stichwörter der Autor:innen

3D object recognition3D pose estimationdexterous manipulationpoint cloud

Autor:innen und Institutionen

  • Graduate School of Computer Science and Engineering, University of Aizu, Aizu-Wakamatsu, Fukushima 965-0006, Japan.

ORCID-Profile: Udaka A Manawadu, Naruse Keitaro

Förderung

  • F-REI

Zitieren

APA

Manawadu, U. A., & Keitaro, N. (2024). Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data. Sensors, 24(21), 6823. https://doi.org/10.3390/s24216823

Vancouver

Manawadu UA, Keitaro N. Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data. Sensors. 2024;24(21):6823. doi:10.3390/s24216823

BibTeX
@article{Manawadu2024,
  author = {Manawadu, Udaka A and Keitaro, Naruse},
  title = {Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {21},
  pages = {6823},
  doi = {10.3390/s24216823}
}
Kostenlos starten →