EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Developing Machine Vision in Tree-Fruit Applications—Fruit Count, Fruit Size and Branch Avoidance in Automated Harvesting

Chiranjivi Neupane iD, Kerry B Walsh iD, Rafael Goulart iD, Anand Koirala iD

Sensors · 29.08.2024 · 24 (17) · 5593

DOI: 10.3390/s24175593 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 29.08.2024. Verfasst von Chiranjivi Neupane und 3 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Future Farming Systems, Central Queensland University, Rockhampton 4701, Australia. Hauptthemen laut MEDLINE: Fruit, Mangifera, Neural Networks, Computer. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: AusIndustry, CQU/Manbulloo Elevate Scholarship, CQU Elevate living allowance scholarship.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent developments in affordable depth imaging hardware and the use of 2D Convolutional Neural Networks (CNN) in object detection and segmentation have accelerated the adoption of machine vision in a range of applications, with mainstream models often out-performing previous application-specific architectures. The need for the release of training and test datasets with any work reporting model development is emphasized to enable the re-evaluation of published work. An additional reporting need is the documentation of the performance of the re-training of a given model, quantifying the impact of stochastic processes in training. Three mango orchard applications were considered: the (i) fruit count, (ii) fruit size and (iii) branch avoidance in automated harvesting. All training and test datasets used in this work are available publicly. The mAP ‘coefficient of variation’ (Standard Deviation, SD, divided by mean of predictions using models of repeated trainings × 100) was approximately 0.2% for the fruit detection model and 1 and 2% for the fruit and branch segmentation models, respectively. A YOLOv8m model achieved a mAP50 of 99.3%, outperforming the previous benchmark, the purpose-designed ‘MangoYOLO’, for the application of the real-time detection of mango fruit on images of tree canopies using an edge computing device as a viable use case. YOLOv8 and v9 models outperformed the benchmark MaskR-CNN model in terms of their accuracy and inference time, achieving up to a 98.8% mAP50 on fruit predictions and 66.2% on branches in a leafy canopy. For fruit sizing, the accuracy of YOLOv8m-seg was like that achieved using Mask R-CNN, but the inference time was much shorter, again an enabler for the field adoption of this technology. A branch avoidance algorithm was proposed, where the implementation of this algorithm in real-time on an edge computing device was enabled by the short inference time of a YOLOv8-seg model for branches and fruit. This capability contributes to the development of automated fruit harvesting.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FruitMangiferaNeural Networks, ComputerTreesAlgorithmsImage Processing, Computer-Assisted

Stichwörter der Autor:innen

automationdeep learningimage segmentationmachine visionmango

Autor:innen und Institutionen

  • Institute for Future Farming Systems, Central Queensland University, Rockhampton 4701, Australia.

ORCID-Profile: Chiranjivi Neupane, Kerry B Walsh, Rafael Goulart, Anand Koirala

Förderung

  • AusIndustry
  • CQU/Manbulloo Elevate Scholarship
  • CQU Elevate living allowance scholarship
  • AusIndustry AC

Zitieren

APA

Neupane, C., Walsh, K. B., Goulart, R., & Koirala, A. (2024). Developing Machine Vision in Tree-Fruit Applications—Fruit Count, Fruit Size and Branch Avoidance in Automated Harvesting. Sensors, 24(17), 5593. https://doi.org/10.3390/s24175593

Vancouver

Neupane C, Walsh KB, Goulart R, Koirala A. Developing Machine Vision in Tree-Fruit Applications—Fruit Count, Fruit Size and Branch Avoidance in Automated Harvesting. Sensors. 2024;24(17):5593. doi:10.3390/s24175593

BibTeX
@article{Neupane2024,
  author = {Neupane, Chiranjivi and Walsh, Kerry B and Goulart, Rafael and Koirala, Anand},
  title = {Developing Machine Vision in Tree-Fruit Applications—Fruit Count, Fruit Size and Branch Avoidance in Automated Harvesting},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {17},
  pages = {5593},
  doi = {10.3390/s24175593}
}
Kostenlos starten →