EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Occluded apples orientation estimator based on deep learning model for robotic harvesting

Eugene Kok, Chao Chen

Computers and Electronics in Agriculture · 2024-04 · 219 · 108781

DOI: 10.1016/j.compag.2024.108781 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers and Electronics in Agriculture, 2024-04. Verfasst von Eugene Kok und 1 weiteren Autor:innen. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Apple harvesting robot is in rapid development in the recent years due to the shortage of manual labor. Robotics vision system has been one of the main focus in the development to achieve successful grasping. Information such as the apple orientation is valuable for developing more effective fruit detachment strategies. Occlusions in the orchard environment and the lack of distinct features in an apple has made it challenging to identify the apple orientation. Our study presents a novel approach that aims to estimate the orientation of fruits by projecting 2D information onto a 3D space. This method specifically targets the field of robotic harvesting and leverages multiple well-established and reliable fundamental methods currently available that includes keypoint detection neural network and circle detection based on extracted line segments of occluded apple. Based on the extracted information, a unit vector that represents orientation of the apple can be computed and transformed according to the relative position between the apple and the camera. The proposed method is evaluated using a publicly available 3D point cloud data of 11 apple trees from an orchard farm that was additionally labeled manually with apple orientations. To verify the evaluation results, the proposed method is tested by integrating it into an apple harvesting robot to perform inspection. Results shows that the median angular error in the orchard setting is 17.6° whilst in the lab setting is 14.6°. The experimental results show that the performance of the proposed method is comparable to existing research when under heavy occlusion and thus it is suitable for harvesting robot operating in the orchard farm.

Zitieren

APA

Kok, E., & Chen, C. (2024). Occluded apples orientation estimator based on deep learning model for robotic harvesting. Computers and Electronics in Agriculture, 219, 108781. https://doi.org/10.1016/j.compag.2024.108781

Vancouver

Kok E, Chen C. Occluded apples orientation estimator based on deep learning model for robotic harvesting. Computers and Electronics in Agriculture. 2024;219:108781. doi:10.1016/j.compag.2024.108781

BibTeX
@article{Kok2024,
  author = {Kok, Eugene and Chen, Chao},
  title = {Occluded apples orientation estimator based on deep learning model for robotic harvesting},
  journal = {Computers and Electronics in Agriculture},
  year = {2024},
  volume = {219},
  pages = {108781},
  doi = {10.1016/j.compag.2024.108781}
}
Kostenlos starten →