EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Automatic Apple Detection and Counting with AD-YOLO and MR-SORT

Xueliang Yang, Yapeng Gao, Mengyu Yin, Haifang Li

Sensors · 31.10.2024 · 24 (21) · 7012

DOI: 10.3390/s24217012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 31.10.2024. Verfasst von Xueliang Yang und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Jinzhong 030600, China. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: CentralGuided Local Science and Technology Development Fund of Shanxi Province, Shanxi Province Key R\&D Program Projects, Shanxi Province Key R&D Program Projects.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the production management of agriculture, accurate fruit counting plays a vital role in the orchard yield estimation and appropriate production decisions. Although recent tracking-by-detection algorithms have emerged as a promising fruit-counting method, they still cannot completely avoid fruit occlusion and light variations in complex orchard environments, and it is difficult to realize automatic and accurate apple counting. In this paper, a video-based multiple-object tracking method, MR-SORT (Multiple Rematching SORT), is proposed based on the improved YOLOv8 and BoT-SORT. First, we propose the AD-YOLO model, which aims to reduce the number of incorrect detections during object tracking. In the YOLOv8s backbone network, an Omni-dimensional Dynamic Convolution (ODConv) module is used to extract local feature information and enhance the model’s ability better; a Global Attention Mechanism (GAM) is introduced to improve the detection ability of a foreground object (apple) in the whole image; a Soft Spatial Pyramid Pooling Layer (SSPPL) is designed to reduce the feature information dispersion and increase the sensory field of the network. Then, the improved BoT-SORT algorithm is proposed by fusing the verification mechanism, SURF feature descriptors, and the Vector of Local Aggregate Descriptors (VLAD) algorithm, which can match apples more accurately in adjacent video frames and reduce the probability of ID switching in the tracking process. The results show that the mAP metrics of the proposed AD-YOLO model are 3.1% higher than those of the YOLOv8 model, reaching 96.4%. The improved tracking algorithm has 297 fewer ID switches, which is 35.6% less than the original algorithm. The multiple-object tracking accuracy of the improved algorithm reached 85.6%, and the average counting error was reduced to 0.07. The coefficient of determination R2 between the ground truth and the predicted value reached 0.98. The above metrics show that our method can give more accurate counting results for apples and even other types of fruit.

Schlagwörter

Stichwörter der Autor:innen

BoT-SORTYOLOv8appearance featuresapple countingmultiple-object tracking

Autor:innen und Institutionen

  • College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Jinzhong 030600, China.
  • College of Computer Information Engineering, Shanxi Technology and Business University, Taiyuan 030006, China.

Förderung

  • CentralGuided Local Science and Technology Development Fund of Shanxi Province
  • Shanxi Province Key R\&D Program Projects
  • Shanxi Province Key R&D Program Projects
  • the Central Guided Local Science and Technology Development Fund of Shanxi Province
  • the Shanxi Basic Research Program

Zitieren

APA

Yang, X., Gao, Y., Yin, M., & Li, H. (2024). Automatic Apple Detection and Counting with AD-YOLO and MR-SORT. Sensors, 24(21), 7012. https://doi.org/10.3390/s24217012

Vancouver

Yang X, Gao Y, Yin M, Li H. Automatic Apple Detection and Counting with AD-YOLO and MR-SORT. Sensors. 2024;24(21):7012. doi:10.3390/s24217012

BibTeX
@article{Yang2024,
  author = {Yang, Xueliang and Gao, Yapeng and Yin, Mengyu and Li, Haifang},
  title = {Automatic Apple Detection and Counting with AD-YOLO and MR-SORT},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {21},
  pages = {7012},
  doi = {10.3390/s24217012}
}
Kostenlos starten →