EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning

Jackey J K Chai iD, Jun-Li Xu iD, Carol O'Sullivan

Sensors · 03.09.2023 · 23 (17) · 7639

DOI: 10.3390/s23177639 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 03.09.2023. Verfasst von Jackey J K Chai und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Statistics, Trinity College Dublin, D02 PN40 Dublin, Ireland. Hauptthemen laut MEDLINE: Fragaria, Augmented Reality, Deep Learning, Labor, Obstetric. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Science Foundation Ireland Centre for Research Training in Digitally Enhanced Reality (d-real).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Currently, strawberry harvesting relies heavily on human labour and subjective assessments of ripeness, resulting in inconsistent post-harvest quality. Therefore, the aim of this work is to automate this process and provide a more accurate and efficient way of assessing ripeness. We explored a unique combination of YOLOv7 object detection and augmented reality technology to detect and visualise the ripeness of strawberries. Our results showed that the proposed YOLOv7 object detection model, which employed transfer learning, fine-tuning and multi-scale training, accurately identified the level of ripeness of each strawberry with an mAP of 0.89 and an F1 score of 0.92. The tiny models have an average detection time of 18 ms per frame at a resolution of 1280 × 720 using a high-performance computer, thereby enabling real-time detection in the field. Our findings distinctly establish the superior performance of YOLOv7 when compared to other cutting-edge methodologies. We also suggest using Microsoft HoloLens 2 to overlay predicted ripeness labels onto each strawberry in the real world, providing a visual representation of the ripeness level. Despite some challenges, this work highlights the potential of augmented reality to assist farmers in harvesting support, which could have significant implications for current agricultural practices.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FragariaAugmented RealityDeep LearningLabor, ObstetricHumansPregnancyFemaleAgriculture

Stichwörter der Autor:innen

YOLOv7augmented realitydeep learningripenessstrawberry

Autor:innen und Institutionen

  • School of Computer Science and Statistics, Trinity College Dublin, D02 PN40 Dublin, Ireland.
  • School of Biosystems and Food Engineering, University College Dublin, D04 V1W8 Dublin, Ireland.

ORCID-Profile: Jackey J K Chai, Jun-Li Xu

Förderung

  • the Science Foundation Ireland Centre for Research Training in Digitally Enhanced Reality (d-real)

Zitieren

APA

Chai, J. J. K., Xu, J. L., & O'Sullivan, C. (2023). Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning. Sensors, 23(17), 7639. https://doi.org/10.3390/s23177639

Vancouver

Chai JJK, Xu JL, O'Sullivan C. Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning. Sensors. 2023;23(17):7639. doi:10.3390/s23177639

BibTeX
@article{Chai2023,
  author = {Chai, Jackey J K and Xu, Jun-Li and O'Sullivan, Carol},
  title = {Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {17},
  pages = {7639},
  doi = {10.3390/s23177639}
}
Kostenlos starten →