EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes

Zhiqiang Gao iD, Mengqi Li, Huihui Bai, Jinze Li, Sifan Li, Jing Han, Zhengkai Wang

Sensors · 16.07.2026 · 26 (14) · 4524

DOI: 10.3390/s26144524 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 16.07.2026. Verfasst von Zhiqiang Gao und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Automation, Taiyuan Institute of Technology, Taiyuan 030008, China. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Department of Science and Technology of Shanxi Province, Shanxi Provincial Department of Education.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In complex backgrounds and under severe occlusions, the accuracy of vision-based robotic grasping pose estimation decreases significantly, further making objects difficult to manipulate and grasp. This paper proposes an iterative closed-loop optimization framework that deeply couples SAM with FoundationPose. The framework breaks through the open-loop logic bottleneck of “segmentation first, then estimation” found in traditional vision algorithms and constructs a mask correction mechanism based on rendered projection. By performing 3D rendering of the initially estimated 6D pose, a geometric prior mask of the object is generated and then fed back into SAM’s prompt encoder, thereby guiding the model to achieve pixel-level refinement of the target’s boundary in the next perception cycle. Meanwhile, to overcome the blind spots of a single metric, the framework designs a multi-dimensional confidence assessment module that integrates both the 2D image domain and the 3D geometric domain to comprehensively evaluate the reliability of the current pose. The SAM prior, the closed-loop iterative mechanism, and the multi-dimensional confidence assessment module work in synergy to form a complete optimization loop. In robustness experiments on pose estimation under cluttered and stacked scenes, the proposed method achieves an overall ADD-S recall rate of 91.7%, with the average translation and rotation errors reduced to as low as 3.5 mm and 2.1°. In 200 real-world robotic grasping verification trials, the overall grasping success rate reaches 96.5%. These experimental results demonstrate the effectiveness and enhanced robustness of the proposed closed-loop optimization framework in the tested unstructured environments.

Schlagwörter

Stichwörter der Autor:innen

SAM-FoundationPosecluttered stacking scenesiterative closed-looppose estimationvisual grasping

Autor:innen und Institutionen

  • Department of Automation, Taiyuan Institute of Technology, Taiyuan 030008, China.
  • College of Mechatronic Engineering, North University of China, Taiyuan 030051, China.

ORCID-Profile: Zhiqiang Gao

Förderung

  • Department of Science and Technology of Shanxi Province
  • Shanxi Provincial Department of Education

Zitieren

APA

Gao, Z., Li, M., Bai, H., Li, J., Li, S., Han, J., & Wang, Z. (2026). A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes. Sensors, 26(14), 4524. https://doi.org/10.3390/s26144524

Vancouver

Gao Z, Li M, Bai H, Li J, Li S, Han J, et al. A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes. Sensors. 2026;26(14):4524. doi:10.3390/s26144524

BibTeX
@article{Gao2026,
  author = {Gao, Zhiqiang and Li, Mengqi and Bai, Huihui and Li, Jinze and Li, Sifan and Han, Jing and Wang, Zhengkai},
  title = {A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {14},
  pages = {4524},
  doi = {10.3390/s26144524}
}
Kostenlos starten →