EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

On-tree fruit image segmentation comparing Mask R-CNN and Vision Transformer models. Application in a novel algorithm for pixel-based fruit size estimation

Jaime Giménez-Gallego, Jesús Martinez-del-Rincon, Juan D. González-Teruel, Honorio Navarro-Hellín, Pedro J. Navarro, Roque Torres-Sánchez

Computers and Electronics in Agriculture · 2024-07 · 222 · 109077

DOI: 10.1016/j.compag.2024.109077 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers and Electronics in Agriculture, 2024-07. Verfasst von Jaime Giménez-Gallego und 5 weiteren Autor:innen. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agencia Estatal de Investigación, Gobierno de España Ministerio de Ciencia, Innovación y Universidades, Comunidad Autónoma de la Región de Murcia.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In situ automatic fruit monitoring is of great interest for more accurate and cost-efficient decision making in agriculture. For this purpose, the development of computer vision-based tools is essential. Deep Learning techniques have shown good performance in fruit detection and segmentation. Recently, new models based on Transformer architecture have emerged with promising potential and zero-shot inference capability. In this paper, a Deep Learning model, Mask R-CNN, was trained for on-tree pomegranate fruit segmentation and compared with foundational models based on Vision Transformer, Grounding DINO and Segment Anything Model. Results with Mask R-CNN proved a better performance, according to F1 score and AP metrics, and a lower computational cost, according to prediction time. One of the most interesting derived applications from fruit segmentation is fruit size estimation. However, segmented fruit masks are frequently incomplete due to occlusions. Therefore, image fruit size estimation is not a straightforward process. In this work, we also propose a novel algorithm to estimate and monitor the fruit size in pixel units from the automated masks. A median relative error of 1.39% was obtained, demonstrating the potential and feasibility of future fully-automatic fruit size estimators.

Förderung

  • Agencia Estatal de Investigación
  • Gobierno de España Ministerio de Ciencia, Innovación y Universidades
  • Comunidad Autónoma de la Región de Murcia
  • Fundación Séneca
  • European Union

Zitieren

APA

Giménez-Gallego, J., Martinez-del-Rincon, J., González-Teruel, J. D., Navarro-Hellín, H., Navarro, P. J., & Torres-Sánchez, R. (2024). On-tree fruit image segmentation comparing Mask R-CNN and Vision Transformer models. Application in a novel algorithm for pixel-based fruit size estimation. Computers and Electronics in Agriculture, 222, 109077. https://doi.org/10.1016/j.compag.2024.109077

Vancouver

Giménez-Gallego J, Martinez-del-Rincon J, González-Teruel JD, Navarro-Hellín H, Navarro PJ, Torres-Sánchez R. On-tree fruit image segmentation comparing Mask R-CNN and Vision Transformer models. Application in a novel algorithm for pixel-based fruit size estimation. Computers and Electronics in Agriculture. 2024;222:109077. doi:10.1016/j.compag.2024.109077

BibTeX
@article{GimnezGallego2024,
  author = {Giménez-Gallego, Jaime and Martinez-del-Rincon, Jesús and González-Teruel, Juan D. and Navarro-Hellín, Honorio and Navarro, Pedro J. and Torres-Sánchez, Roque},
  title = {On-tree fruit image segmentation comparing Mask R-CNN and Vision Transformer models. Application in a novel algorithm for pixel-based fruit size estimation},
  journal = {Computers and Electronics in Agriculture},
  year = {2024},
  volume = {222},
  pages = {109077},
  doi = {10.1016/j.compag.2024.109077}
}
Kostenlos starten →