Deep Learning-Based Real-Time 6D Pose Estimation and Multi-Mode Tracking Algorithms for Citrus-Harvesting Robots
Machines · 13.09.2024 · 12 (9) · 642
DOI: 10.3390/machines12090642 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machines, online erschienen am 13.09.2024. Verfasst von Hyun-Jung Hwang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea Institute of Planning and Evaluation for Technology in Food, Agriculture and Forestry.
Abstract (Originalsprache)
In the agricultural sector, utilizing robots for tasks such as fruit harvesting poses significant challenges, particularly in achieving accurate 6D pose estimation of the target objects, which is essential for precise and efficient harvesting. Particularly, fruit harvesting relies heavily on manual labor, leading to issues with an unstable labor supply and rising costs. To solve these problems, agricultural harvesting robots are gaining attention. However, effective harvesting necessitates accurate 6D pose estimation of the target object. This study proposes a method to enhance the performance of fruit-harvesting robots, including the development of a dataset named HWANGMOD, which was created using both virtual and real environments with tools such as Blender and BlenderProc. Additionally, we present methods for training an EfficientPose-based model for 6D pose estimation and ripeness classification, and an algorithm for determining the optimal harvest sequence among multiple fruits. Finally, we propose a multi-object tracking method using coordinates estimated by deep learning models to improve the robot’s performance in dynamic environments. The proposed methods were evaluated using metrics such as ADD and ADDS, showing that the deep learning model for agricultural harvesting robots excelled in accuracy, robustness, and real-time processing. These advancements contribute to the potential for commercialization of agricultural harvesting robots and the broader field of agricultural automation technology.
Förderung
- Korea Institute of Planning and Evaluation for Technology in Food, Agriculture and Forestry
Zitieren
APA
Hwang, H., Cho, J., & Kim, Y. (2024). Deep Learning-Based Real-Time 6D Pose Estimation and Multi-Mode Tracking Algorithms for Citrus-Harvesting Robots. Machines, 12(9), 642. https://doi.org/10.3390/machines12090642
Vancouver
Hwang H, Cho J, Kim Y. Deep Learning-Based Real-Time 6D Pose Estimation and Multi-Mode Tracking Algorithms for Citrus-Harvesting Robots. Machines. 2024;12(9):642. doi:10.3390/machines12090642
BibTeX
@article{Hwang2024,
author = {Hwang, Hyun-Jung and Cho, Jae-Hoon and Kim, Yong-Tae},
title = {Deep Learning-Based Real-Time 6D Pose Estimation and Multi-Mode Tracking Algorithms for Citrus-Harvesting Robots},
journal = {Machines},
year = {2024},
volume = {12},
number = {9},
pages = {642},
doi = {10.3390/machines12090642}
}
EUVIMED