Real-Time Constrained Visual Servoing for Agricultural Harvesting Robots via MPC-Guided Reinforcement Learning
AI · 01.04.2026 · 7 (4) · 124
DOI: 10.3390/ai7040124 ↗Kurz gefasst
Fachartikel in der Zeitschrift AI, online erschienen am 01.04.2026. Verfasst von Liangzheng Gao und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Beijing Academy of Agricultural Artificial Intelligence and Robotics-R&D of Key Technologies and Products for Agricultural Robot, Major Science and Technology Support Plan Project Tasks of Hebei Province.
Abstract (Originalsprache)
With the intensification of global agricultural labor shortage and scaled development of facility agriculture, autonomous precision harvesting robots for unstructured greenhouse environments have become an urgent need. For cluster-picking crops such as tomatoes, visual servoing enables real-time closed-loop control of the end-effector pose, addressing challenges of random fruit distribution and variable stem orientations. However, existing methods struggle to balance constraint handling with real-time efficiency. This paper proposes an MPC-Guided Reinforcement Learning visual servoing framework, innovatively combining the planning capability of optimal control with the adaptive learning ability and real-time inference advantages of reinforcement learning. The approach adopts a teacher–student paradigm: expert trajectories from the MPC controller warm-start the reinforcement learning policy through behavior cloning, followed by PPO-based fine-tuning with adaptive gain regulation and stagnation-enhanced exploration mechanisms. Simulation experiments demonstrate a 95% success rate with average positioning and orientation errors of 13.6 mm and 0.009 rad respectively. Compared to MPC baseline, task steps are reduced by 53.4%; compared to Standard PPO, success rate improves by 6%. Greenhouse field validation achieves 85.3% picking success rate and 5.63 s per fruit operation time, confirming the framework’s excellent balance among control precision, robustness, and efficiency for high-precision robotic harvesting in unstructured agricultural environments.
Förderung
- Beijing Academy of Agricultural Artificial Intelligence and Robotics-R&D of Key Technologies and Products for Agricultural Robot
- Major Science and Technology Support Plan Project Tasks of Hebei Province
Zitieren
APA
Gao, L., Feng, Q., Chen, S., Yang, Z., Fan, F., Chen, L., & Zhao, C. (2026). Real-Time Constrained Visual Servoing for Agricultural Harvesting Robots via MPC-Guided Reinforcement Learning. AI, 7(4), 124. https://doi.org/10.3390/ai7040124
Vancouver
Gao L, Feng Q, Chen S, Yang Z, Fan F, Chen L, et al. Real-Time Constrained Visual Servoing for Agricultural Harvesting Robots via MPC-Guided Reinforcement Learning. AI. 2026;7(4):124. doi:10.3390/ai7040124
BibTeX
@article{Gao2026,
author = {Gao, Liangzheng and Feng, Qingchun and Chen, Shiqi and Yang, Zhijie and Fan, Fengcui and Chen, Lin and Zhao, Chunjiang},
title = {Real-Time Constrained Visual Servoing for Agricultural Harvesting Robots via MPC-Guided Reinforcement Learning},
journal = {AI},
year = {2026},
volume = {7},
number = {4},
pages = {124},
doi = {10.3390/ai7040124}
}
EUVIMED