EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

ORB-Livox: A real-time dynamic system for fruit detection and localization

Tianhao Liu, Hanwen Kang, Chao Chen

Computers and Electronics in Agriculture · 2023-06 · 209 · 107834

DOI: 10.1016/j.compag.2023.107834 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers and Electronics in Agriculture, 2023-06. Verfasst von Tianhao Liu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 61-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Australian Research Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate fruit localization plays an essential role in many agricultural tasks and is one of the most vital components of an autonomous harvesting robot. Although fruit localization in stationary conditions has been extensively studied, the method to perform fruit localization in dynamic conditions is rarely studied. Fruit localization under dynamic conditions is much more challenging, since movement will introduce continuously irregular ego-motion on visual sensors, which can lead to considerable accuracy degeneration or even system failure. However, fruit localization under dynamic conditions is an essential task since it can significantly improve the harvesting efficiency. In this study, a fruit localization method is proposed to perform accurate fruit localization under dynamic conditions. Firstly, an ORB-SLAM3 SLAM algorithm is utilized to estimate the camera’s pose under dynamic conditions. Secondly, YOLO-V5 is used to identify apples in RGB images. Moreover, Lidar is used to measure the depth of each apple accurately. Finally, a clustering technique based on the Gaussian distribution is proposed to mitigate the accuracy loss under dynamic conditions to optimize apple positions. Our method is extensively evaluated in indoor and outdoor experiments. The results of indoor experiments show that the average localization error is 21.1 mm, with 90% of the errors are less than 30 mm. The experimental result in an orchard environment demonstrates that our proposed method can detect and localize apples under dynamic conditions in unstructured natural environments.

Förderung

  • Australian Research Council

Zitieren

APA

Liu, T., Kang, H., & Chen, C. (2023). ORB-Livox: A real-time dynamic system for fruit detection and localization. Computers and Electronics in Agriculture, 209, 107834. https://doi.org/10.1016/j.compag.2023.107834

Vancouver

Liu T, Kang H, Chen C. ORB-Livox: A real-time dynamic system for fruit detection and localization. Computers and Electronics in Agriculture. 2023;209:107834. doi:10.1016/j.compag.2023.107834

BibTeX
@article{Liu2023,
  author = {Liu, Tianhao and Kang, Hanwen and Chen, Chao},
  title = {ORB-Livox: A real-time dynamic system for fruit detection and localization},
  journal = {Computers and Electronics in Agriculture},
  year = {2023},
  volume = {209},
  pages = {107834},
  doi = {10.1016/j.compag.2023.107834}
}
Kostenlos starten →