EUVIMEDOpdag EUVIMED
Open access · CC BY-NC-ND 4.0

Autonomous navigation method based on RGB‐D camera for a crop phenotyping robot

Meng Yang, Chenglong Huang, Zhengda Li, Yang Shao, Jinzhan Yuan, Wanneng Yang, Peng Song

Journal of Field Robotics · 2024-12 · 41 (8) · 2663-2675

DOI: 10.1002/rob.22379 ↗

At a glance

Journal article in Journal of Field Robotics, published online on 2024-06-30. Written by Meng Yang and 6 co-authors. Cited 15 times so far (Crossref); 25 references. The full text is freely available (open access, CC BY-NC-ND 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Phenotyping robots have the potential to obtain crop phenotypic traits on a large scale with high throughput. Autonomous navigation technology for phenotyping robots can significantly improve the efficiency of phenotypic traits collection. This study developed an autonomous navigation method utilizing an RGB‐D camera, specifically designed for phenotyping robots in field environments. The PP‐LiteSeg semantic segmentation model was employed due to its real‐time and accurate segmentation capabilities, enabling the distinction of crop areas in images captured by the RGB‐D camera. Navigation feature points were extracted from these segmented areas, with their three‐dimensional coordinates determined from pixel and depth information, facilitating the computation of angle deviation ( α ) and lateral deviation ( d ). Fuzzy controllers were designed with α and d as inputs for real‐time deviation correction during the walking of phenotyping robot. Additionally, the method includes end‐of‐row recognition and row spacing calculation, based on both visible and depth data, enabling automatic turning and row transition. The experimental results showed that the adopted PP‐LiteSeg semantic segmentation model had a testing accuracy of 95.379% and a mean intersection over union of 90.615%. The robot's navigation demonstrated an average walking deviation of 1.33 cm, with a maximum of 3.82 cm. Additionally, the average error in row spacing measurement was 2.71 cm, while the success rate of row transition at the end of the row was 100%. These findings indicate that the proposed method provides effective support for the autonomous operation of phenotyping robots.

Cite

APA

Yang, M., Huang, C., Li, Z., Shao, Y., Yuan, J., Yang, W., & Song, P. (2024). Autonomous navigation method based on RGB‐D camera for a crop phenotyping robot. Journal of Field Robotics, 41(8), 2663-2675. https://doi.org/10.1002/rob.22379

Vancouver

Yang M, Huang C, Li Z, Shao Y, Yuan J, Yang W, et al. Autonomous navigation method based on RGB‐D camera for a crop phenotyping robot. Journal of Field Robotics. 2024;41(8):2663-2675. doi:10.1002/rob.22379

BibTeX
@article{Yang2024,
  author = {Yang, Meng and Huang, Chenglong and Li, Zhengda and Shao, Yang and Yuan, Jinzhan and Yang, Wanneng and Song, Peng},
  title = {Autonomous navigation method based on RGB‐D camera for a crop phenotyping robot},
  journal = {Journal of Field Robotics},
  year = {2024},
  volume = {41},
  number = {8},
  pages = {2663--2675},
  doi = {10.1002/rob.22379}
}
Start for free →