A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes
Sensors · 16.07.2026 · 26 (14) · 4524
DOI: 10.3390/s26144524 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 16.07.2026. Verfasst von Zhiqiang Gao und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Automation, Taiyuan Institute of Technology, Taiyuan 030008, China. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Department of Science and Technology of Shanxi Province, Shanxi Provincial Department of Education.
Abstract (Originalsprache)
In complex backgrounds and under severe occlusions, the accuracy of vision-based robotic grasping pose estimation decreases significantly, further making objects difficult to manipulate and grasp. This paper proposes an iterative closed-loop optimization framework that deeply couples SAM with FoundationPose. The framework breaks through the open-loop logic bottleneck of “segmentation first, then estimation” found in traditional vision algorithms and constructs a mask correction mechanism based on rendered projection. By performing 3D rendering of the initially estimated 6D pose, a geometric prior mask of the object is generated and then fed back into SAM’s prompt encoder, thereby guiding the model to achieve pixel-level refinement of the target’s boundary in the next perception cycle. Meanwhile, to overcome the blind spots of a single metric, the framework designs a multi-dimensional confidence assessment module that integrates both the 2D image domain and the 3D geometric domain to comprehensively evaluate the reliability of the current pose. The SAM prior, the closed-loop iterative mechanism, and the multi-dimensional confidence assessment module work in synergy to form a complete optimization loop. In robustness experiments on pose estimation under cluttered and stacked scenes, the proposed method achieves an overall ADD-S recall rate of 91.7%, with the average translation and rotation errors reduced to as low as 3.5 mm and 2.1°. In 200 real-world robotic grasping verification trials, the overall grasping success rate reaches 96.5%. These experimental results demonstrate the effectiveness and enhanced robustness of the proposed closed-loop optimization framework in the tested unstructured environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Automation, Taiyuan Institute of Technology, Taiyuan 030008, China.
- College of Mechatronic Engineering, North University of China, Taiyuan 030051, China.
ORCID-Profile: Zhiqiang Gao
Förderung
- Department of Science and Technology of Shanxi Province
- Shanxi Provincial Department of Education
Zitieren
APA
Gao, Z., Li, M., Bai, H., Li, J., Li, S., Han, J., & Wang, Z. (2026). A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes. Sensors, 26(14), 4524. https://doi.org/10.3390/s26144524
Vancouver
Gao Z, Li M, Bai H, Li J, Li S, Han J, et al. A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes. Sensors. 2026;26(14):4524. doi:10.3390/s26144524
BibTeX
@article{Gao2026,
author = {Gao, Zhiqiang and Li, Mengqi and Bai, Huihui and Li, Jinze and Li, Sifan and Han, Jing and Wang, Zhengkai},
title = {A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes},
journal = {Sensors},
year = {2026},
volume = {26},
number = {14},
pages = {4524},
doi = {10.3390/s26144524}
}
EUVIMED