EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision-Based Reinforcement Learning for Robotic Grasping of Moving Objects on a Conveyor

Yin Cao, Xuemei Xu, Yazheng Zhang

Machines · 21.10.2025 · 13 (10) · 973

DOI: 10.3390/machines13100973 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machines, online erschienen am 21.10.2025. Verfasst von Yin Cao und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: China Scholarship Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study introduces an autonomous framework for grasping moving objects on a conveyor belt, enabling unsupervised detection, grasping, and categorization. The work focuses on two common object shapes—cylindrical cans and rectangular cartons—transported at a constant speed of 3–7 cm/s on the conveyor, emulating typical scenarios. The proposed framework combines a vision-based neural network for object detection, a target localization algorithm, and a deep reinforcement learning model for robotic control. Specifically, a YOLO-based neural network was employed to detect the 2D position of target objects. These positions are then converted to 3D coordinates, followed by pose estimation and error correction. A Proximal Policy Optimization (PPO) algorithm was then used to provide continuous control decisions for the robotic arm. A tailored reinforcement learning environment was developed using the Gymnasium interface. Training and validation were conducted on a 7-degree-of-freedom (7-DOF) robotic arm model in the PyBullet physics simulation engine. By leveraging transfer learning and curriculum learning strategies, the robotic agent effectively learned to grasp multiple categories of moving objects. Simulation experiments and randomized trials show that the proposed method enables the 7-DOF robotic arm to consistently grasp conveyor belt objects, achieving an approximately 80% success rate at conveyor speeds of 0.03–0.07 m/s. These results demonstrate the potential of the framework for deployment in automated handling applications.

Förderung

  • China Scholarship Council

Zitieren

APA

Cao, Y., Xu, X., & Zhang, Y. (2025). Vision-Based Reinforcement Learning for Robotic Grasping of Moving Objects on a Conveyor. Machines, 13(10), 973. https://doi.org/10.3390/machines13100973

Vancouver

Cao Y, Xu X, Zhang Y. Vision-Based Reinforcement Learning for Robotic Grasping of Moving Objects on a Conveyor. Machines. 2025;13(10):973. doi:10.3390/machines13100973

BibTeX
@article{Cao2025,
  author = {Cao, Yin and Xu, Xuemei and Zhang, Yazheng},
  title = {Vision-Based Reinforcement Learning for Robotic Grasping of Moving Objects on a Conveyor},
  journal = {Machines},
  year = {2025},
  volume = {13},
  number = {10},
  pages = {973},
  doi = {10.3390/machines13100973}
}
Kostenlos starten →