Cherry Tomato Detection for Harvesting Using Multimodal Perception and an Improved YOLOv7-Tiny Neural Network
Agronomy · 09.10.2024 · 14 (10) · 2320
DOI: 10.3390/agronomy14102320 ↗Kurz gefasst
Fachartikel in der Zeitschrift Agronomy, online erschienen am 09.10.2024. Verfasst von Yingqi Cai und 7 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shenzhen University.
Abstract (Originalsprache)
Robotic fruit harvesting has great potential to revolutionize agriculture, but detecting cherry tomatoes in farming environments still faces challenges in accuracy and efficiency. To overcome the shortcomings of existing cherry tomato detection methods for harvesting, this study introduces a deep-learning-based cherry tomato detection scheme for robotic harvesting in greenhouses using multimodal RGB-D perception and an improved YOLOv7-tiny Cherry Tomato Detection (YOLOv7-tiny-CTD) network, which has been modified from the original YOLOv7-tiny by eliminating the “Objectness” output layer, introducing a new “Classness” method for the prediction box, and incorporating a new hybrid non-maximum suppression. Acquired RGB-D images undergo preprocessing such as color space transformation, point cloud normal vector angle computation, and multimodal regions of interest segmentation before being fed into the YOLOv7-tiny-CTD. The proposed method was tested using an AGV-based robot in a greenhouse cherry tomato farming facility. The results indicate that the multimodal perception and deep learning method improves detection precision and accuracy over existing methods while running in real time, and the robot achieved over 80% successful picking rates in two-trial mode in the greenhouse farm, showing promising potential for practical harvesting applications.
Förderung
- Shenzhen University
Zitieren
APA
Cai, Y., Cui, B., Deng, H., Zeng, Z., Wang, Q., Lu, D., Cui, Y., & Tian, Y. (2024). Cherry Tomato Detection for Harvesting Using Multimodal Perception and an Improved YOLOv7-Tiny Neural Network. Agronomy, 14(10), 2320. https://doi.org/10.3390/agronomy14102320
Vancouver
Cai Y, Cui B, Deng H, Zeng Z, Wang Q, Lu D, et al. Cherry Tomato Detection for Harvesting Using Multimodal Perception and an Improved YOLOv7-Tiny Neural Network. Agronomy. 2024;14(10):2320. doi:10.3390/agronomy14102320
BibTeX
@article{Cai2024,
author = {Cai, Yingqi and Cui, Bo and Deng, Hong and Zeng, Zhi and Wang, Qicong and Lu, Dajiang and Cui, Yukang and Tian, Yibin},
title = {Cherry Tomato Detection for Harvesting Using Multimodal Perception and an Improved YOLOv7-Tiny Neural Network},
journal = {Agronomy},
year = {2024},
volume = {14},
number = {10},
pages = {2320},
doi = {10.3390/agronomy14102320}
}
EUVIMED