Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning
Sensors · 03.09.2023 · 23 (17) · 7639
DOI: 10.3390/s23177639 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 03.09.2023. Verfasst von Jackey J K Chai und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Statistics, Trinity College Dublin, D02 PN40 Dublin, Ireland. Hauptthemen laut MEDLINE: Fragaria, Augmented Reality, Deep Learning, Labor, Obstetric. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Science Foundation Ireland Centre for Research Training in Digitally Enhanced Reality (d-real).
Abstract (Originalsprache)
Currently, strawberry harvesting relies heavily on human labour and subjective assessments of ripeness, resulting in inconsistent post-harvest quality. Therefore, the aim of this work is to automate this process and provide a more accurate and efficient way of assessing ripeness. We explored a unique combination of YOLOv7 object detection and augmented reality technology to detect and visualise the ripeness of strawberries. Our results showed that the proposed YOLOv7 object detection model, which employed transfer learning, fine-tuning and multi-scale training, accurately identified the level of ripeness of each strawberry with an mAP of 0.89 and an F1 score of 0.92. The tiny models have an average detection time of 18 ms per frame at a resolution of 1280 × 720 using a high-performance computer, thereby enabling real-time detection in the field. Our findings distinctly establish the superior performance of YOLOv7 when compared to other cutting-edge methodologies. We also suggest using Microsoft HoloLens 2 to overlay predicted ripeness labels onto each strawberry in the real world, providing a visual representation of the ripeness level. Despite some challenges, this work highlights the potential of augmented reality to assist farmers in harvesting support, which could have significant implications for current agricultural practices.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computer Science and Statistics, Trinity College Dublin, D02 PN40 Dublin, Ireland.
- School of Biosystems and Food Engineering, University College Dublin, D04 V1W8 Dublin, Ireland.
ORCID-Profile: Jackey J K Chai, Jun-Li Xu
Förderung
- the Science Foundation Ireland Centre for Research Training in Digitally Enhanced Reality (d-real)
Zitieren
APA
Chai, J. J. K., Xu, J. L., & O'Sullivan, C. (2023). Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning. Sensors, 23(17), 7639. https://doi.org/10.3390/s23177639
Vancouver
Chai JJK, Xu JL, O'Sullivan C. Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning. Sensors. 2023;23(17):7639. doi:10.3390/s23177639
BibTeX
@article{Chai2023,
author = {Chai, Jackey J K and Xu, Jun-Li and O'Sullivan, Carol},
title = {Real-Time Detection of Strawberry Ripeness Using Augmented Reality and Deep Learning},
journal = {Sensors},
year = {2023},
volume = {23},
number = {17},
pages = {7639},
doi = {10.3390/s23177639}
}
EUVIMED