EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Visual-language-guided task planning for horticultural robots

Jose Cuaran, Kendall Koe, Aditya Potnis, Naveen K. Uppalapati, Girish Chowdhary

Computers and Electronics in Agriculture · 2026-09 · 252 · 112058

DOI: 10.1016/j.compag.2026.112058 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers and Electronics in Agriculture, 2026-09. Verfasst von Jose Cuaran und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: USDA NIFA.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Crop monitoring is essential for precision agriculture, but current systems lack high-level reasoning. We introduce a novel, modular framework that uses a Vision Language Model (VLM) to guide robotic task planning by actively querying heterogeneous data sources—including enriched RGB camera feeds and 2D semantic occupancy maps—interleaved with robotic action primitives. We contribute a comprehensive benchmark for short- and long-horizon crop monitoring tasks in monoculture and polyculture environments. Our results show that while zero-shot VLMs perform robustly for short-horizon tasks (achieving 87% success, comparable to human experts), success drops significantly to under 10% for complex long-horizon, multi-target tasks. Despite this decline, task completion rates remain above 76% under noiseless conditions. Critically, the system degrades when relying on noisy semantic maps, demonstrating a key limitation in current VLM context grounding for sustained robotic operations. This work offers a deployable framework and critical insights into VLM capabilities and shortcomings for complex agricultural robotics. Supplementary material: https://kendallkoe.com/Visual-Language-Guided-Task-Planning-for-Horticultural-Robots/ .

Förderung

  • USDA NIFA

Zitieren

APA

Cuaran, J., Koe, K., Potnis, A., Uppalapati, N. K., & Chowdhary, G. (2026). Visual-language-guided task planning for horticultural robots. Computers and Electronics in Agriculture, 252, 112058. https://doi.org/10.1016/j.compag.2026.112058

Vancouver

Cuaran J, Koe K, Potnis A, Uppalapati NK, Chowdhary G. Visual-language-guided task planning for horticultural robots. Computers and Electronics in Agriculture. 2026;252:112058. doi:10.1016/j.compag.2026.112058

BibTeX
@article{Cuaran2026,
  author = {Cuaran, Jose and Koe, Kendall and Potnis, Aditya and Uppalapati, Naveen K. and Chowdhary, Girish},
  title = {Visual-language-guided task planning for horticultural robots},
  journal = {Computers and Electronics in Agriculture},
  year = {2026},
  volume = {252},
  pages = {112058},
  doi = {10.1016/j.compag.2026.112058}
}
Kostenlos starten →