EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Imitation Learning from a Single Demonstration Leveraging Vector Quantization for Robotic Harvesting

Antonios Porichis, Myrto Inglezou, Nikolaos Kegkeroglou, Vishwanathan Mohan, Panagiotis Chatzakos

Robotics · 30.06.2024 · 13 (7) · 98

DOI: 10.3390/robotics13070098 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Robotics, online erschienen am 30.06.2024. Verfasst von Antonios Porichis und 4 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: EU’s Horizon 2020 research and innovation program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The ability of robots to tackle complex non-repetitive tasks will be key in bringing a new level of automation in agricultural applications still involving labor-intensive, menial, and physically demanding activities due to high cognitive requirements. Harvesting is one such example as it requires a combination of motions which can generally be broken down into a visual servoing and a manipulation phase, with the latter often being straightforward to pre-program. In this work, we focus on the task of fresh mushroom harvesting which is still conducted manually by human pickers due to its high complexity. A key challenge is to enable harvesting with low-cost hardware and mechanical systems, such as soft grippers which present additional challenges compared to their rigid counterparts. We devise an Imitation Learning model pipeline utilizing Vector Quantization to learn quantized embeddings directly from visual inputs. We test this approach in a realistic environment designed based on recordings of human experts harvesting real mushrooms. Our models can control a cartesian robot with a soft, pneumatically actuated gripper to successfully replicate the mushroom outrooting sequence. We achieve 100% success in picking mushrooms among distractors with less than 20 min of data collection comprising a single expert demonstration and auxiliary, non-expert, trajectories. The entire model pipeline requires less than 40 min of training on a single A4000 GPU and approx. 20 ms for inference on a standard laptop GPU.

Förderung

  • EU’s Horizon 2020 research and innovation program

Zitieren

APA

Porichis, A., Inglezou, M., Kegkeroglou, N., Mohan, V., & Chatzakos, P. (2024). Imitation Learning from a Single Demonstration Leveraging Vector Quantization for Robotic Harvesting. Robotics, 13(7), 98. https://doi.org/10.3390/robotics13070098

Vancouver

Porichis A, Inglezou M, Kegkeroglou N, Mohan V, Chatzakos P. Imitation Learning from a Single Demonstration Leveraging Vector Quantization for Robotic Harvesting. Robotics. 2024;13(7):98. doi:10.3390/robotics13070098

BibTeX
@article{Porichis2024,
  author = {Porichis, Antonios and Inglezou, Myrto and Kegkeroglou, Nikolaos and Mohan, Vishwanathan and Chatzakos, Panagiotis},
  title = {Imitation Learning from a Single Demonstration Leveraging Vector Quantization for Robotic Harvesting},
  journal = {Robotics},
  year = {2024},
  volume = {13},
  number = {7},
  pages = {98},
  doi = {10.3390/robotics13070098}
}
Kostenlos starten →