Object Pose Estimation From RGB-D Images With Affordance-Instance Segmentation Constraint for Semantic Robot Manipulation
IEEE Robotics and Automation Letters · 2024-01 · 9 (1) · 595-602
DOI: 10.1109/lra.2023.3333693 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Robotics and Automation Letters, 2024-01. Verfasst von Zhongli Wang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 41 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Technology Project of Hebei Education Department, High Level Talent Funding Project of Hebei Province.
Abstract (Originalsprache)
Object pose estimation is a crucial task for semantic robot manipulation involving the detection of suitable manipulation regions. Given the diversity of object shapes and scene complexities, object pose estimation remains an immense challenge. Accordingly, the letter presents a new approach for object pose estimation from RGB-D images, utilizing the affordance-instance segmentation constraint for semantic robot manipulation. An Object Affordance-Instance Segmentation Network (OAISNet) is designed to improve the segmentation accuracy of both object affordances and object instances. The training of the OAISNet necessitates a substantial quantity of data. A dataset automatic generation method is designed to quickly generate data with multiple labels, reducing the burden of manual annotation. Finally, object affordances are combined with the point pair features to establish affordance-based point pair features for object pose estimation. Experimental results show that the OAISNet improves the performance of object segmentation, and the affordance-based object pose estimation approach improves the accuracy and efficiency of object pose estimation.
Förderung
- National Natural Science Foundation of China
- Technology Project of Hebei Education Department
- High Level Talent Funding Project of Hebei Province
Zitieren
APA
Wang, Z., & Tian, G. (2024). Object Pose Estimation From RGB-D Images With Affordance-Instance Segmentation Constraint for Semantic Robot Manipulation. IEEE Robotics and Automation Letters, 9(1), 595-602. https://doi.org/10.1109/lra.2023.3333693
Vancouver
Wang Z, Tian G. Object Pose Estimation From RGB-D Images With Affordance-Instance Segmentation Constraint for Semantic Robot Manipulation. IEEE Robotics and Automation Letters. 2024;9(1):595-602. doi:10.1109/lra.2023.3333693
BibTeX
@article{Wang2024,
author = {Wang, Zhongli and Tian, Guohui},
title = {Object Pose Estimation From RGB-D Images With Affordance-Instance Segmentation Constraint for Semantic Robot Manipulation},
journal = {IEEE Robotics and Automation Letters},
year = {2024},
volume = {9},
number = {1},
pages = {595--602},
doi = {10.1109/lra.2023.3333693}
}
EUVIMED