EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Finger vision enabled real-time defect detection in robotic harvesting

Hugh Zhou, Ayham Ahmed, Tianhao Liu, Michael Romeo, Timothy Beh, Yaoqiang Pan, Hanwen Kang, Chao Chen

Computers and Electronics in Agriculture · 2025-07 · 234 · 110222

DOI: 10.1016/j.compag.2025.110222 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers and Electronics in Agriculture, 2025-07. Verfasst von Hugh Zhou und 7 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Department of Education, Australian Government, Australian Government Department of Education.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study introduces a pioneering solution for pre-harvest fruit defect detection in the agricultural industry. Manual inspection by human pickers is inconsistent and labour-intensive, while traditional automated methods require harvested fruits to be placed in controlled environments, leading to wasted time and resources on picking and transporting defective fruits. This research presents a novel, finger vision-enabled, real-time defect detection method for robotic harvesting. Based on a comprehensive analysis of camera configurations for fruit inspection, an eye-in-finger configuration is proposed for the first time in the field, a versatile finger is created that transforms a robotic gripper from merely a grasping tool into a powerful inspection device, potentially achieving 81% and 89% higher fruit surface coverage compared to the eye-on-base and eye-in-hand configurations, respectively. A prototype with four low-cost, off-the-shelf cameras embedded in four fingers was built with a gripper to perform rotational inspection around the target fruit. Four YOLOv8 model variants were leveraged and trained to identify defect features from the images collected by the eye-in-finger cameras, demonstrating a precision of up to 98%. A real-time detection algorithm incorporating YOLOv8-p2 was developed and successfully validated in the field with a latency of only 39.2 ms and a model size of 21.4 MB, while utilising less than 20% of the central computer's capacity. The successful field demonstration of the proposed finger vision-based defect detection method indicates a significant potential of automating pre-harvest inspection, reducing labour costs, and mitigating the time and resources spent on post-harvest sorting.

Förderung

  • Department of Education, Australian Government
  • Australian Government Department of Education

Zitieren

APA

Zhou, H., Ahmed, A., Liu, T., Romeo, M., Beh, T., Pan, Y., Kang, H., & Chen, C. (2025). Finger vision enabled real-time defect detection in robotic harvesting. Computers and Electronics in Agriculture, 234, 110222. https://doi.org/10.1016/j.compag.2025.110222

Vancouver

Zhou H, Ahmed A, Liu T, Romeo M, Beh T, Pan Y, et al. Finger vision enabled real-time defect detection in robotic harvesting. Computers and Electronics in Agriculture. 2025;234:110222. doi:10.1016/j.compag.2025.110222

BibTeX
@article{Zhou2025,
  author = {Zhou, Hugh and Ahmed, Ayham and Liu, Tianhao and Romeo, Michael and Beh, Timothy and Pan, Yaoqiang and Kang, Hanwen and Chen, Chao},
  title = {Finger vision enabled real-time defect detection in robotic harvesting},
  journal = {Computers and Electronics in Agriculture},
  year = {2025},
  volume = {234},
  pages = {110222},
  doi = {10.1016/j.compag.2025.110222}
}
Kostenlos starten →