EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Integrating Vision–Language–Action Models and RGB-D Sensing for Robotic Waste Sorting on KUKA LBR iiwa

Teresa Sinico, Daniele Businaro, Giovanni Boschetti

Robotics · 18.05.2026 · 15 (5) · 100

DOI: 10.3390/robotics15050100 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Robotics, online erschienen am 18.05.2026. Verfasst von Teresa Sinico und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Robotic waste sorting presents significant challenges, including object variability, cluttered environments, and the predominant reliance on deep learning and traditional computer vision techniques, which typically demand extensive datasets and task-specific training. This paper introduces a robotic waste sorting system that integrates the Gemini Vision–Language–Action (VLA) model with a KUKA LBR iiwa collaborative robot and an RGB-D camera. Our approach leverages the advanced reasoning capabilities of large, pre-trained VLA models to perform waste sorting, without requiring explicit training or dataset collection. Key contributions include the development of effective prompt engineering strategies for waste object identification, the assessment of the VLA’s performance in terms of inference time and accuracy, and the development of different grasping strategies for operation in cluttered scenarios. Our experimental tests demonstrated that the system’s inference time is between 2 and 4 s, which is suitable for collaborative robotic applications, and the system achieved a high overall classification accuracy of 89.64%. Crucially, we demonstrated that integration of RGB-D sensing enhanced the model’s ability to perceive object heights, resolve occlusions, and make informed grasping decisions in realistic, three-dimensional settings. We further validated multiple real-world grasping strategies, demonstrating tradeoffs between system efficiency and safety in heavily cluttered scenarios. This work establishes a practical and adaptable framework for deploying VLA-driven intelligence on commercial robotic platforms, highlighting the potential of VLAs for complex manipulation tasks beyond waste sorting.

Zitieren

APA

Sinico, T., Businaro, D., & Boschetti, G. (2026). Integrating Vision–Language–Action Models and RGB-D Sensing for Robotic Waste Sorting on KUKA LBR iiwa. Robotics, 15(5), 100. https://doi.org/10.3390/robotics15050100

Vancouver

Sinico T, Businaro D, Boschetti G. Integrating Vision–Language–Action Models and RGB-D Sensing for Robotic Waste Sorting on KUKA LBR iiwa. Robotics. 2026;15(5):100. doi:10.3390/robotics15050100

BibTeX
@article{Sinico2026,
  author = {Sinico, Teresa and Businaro, Daniele and Boschetti, Giovanni},
  title = {Integrating Vision–Language–Action Models and RGB-D Sensing for Robotic Waste Sorting on KUKA LBR iiwa},
  journal = {Robotics},
  year = {2026},
  volume = {15},
  number = {5},
  pages = {100},
  doi = {10.3390/robotics15050100}
}
Kostenlos starten →