Toward generalizable crop-weed detection with vision-language models
Smart Agricultural Technology · 2026-12 · 15 · 102512
DOI: 10.1016/j.atech.2026.102512 ↗Kurz gefasst
Fachartikel in der Zeitschrift Smart Agricultural Technology, 2026-12. Verfasst von Boyang Deng und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Michigan Department of Agriculture & Rural Development, USDA Agricultural Marketing Service.
Abstract (Originalsprache)
Effective weed management in vegetable production is increasingly challenged by labor shortages, rising production costs, and mounting pressure to reduce herbicide usage. Conventional deep learning models for crop-weed detection often suffer from performance degradation under the data-scarce scenarios commonly encountered in agricultural vision applications. Vision-language models (VLMs) offer a promising alternative by enabling text-guided detection that leverages semantic descriptions to improve crop-weed differentiation. This research evaluated the performance of three advanced VLM-based detectors, including Grounding DINO, YOLO-World, and Qwen3-VL, for crop-weed detection in vegetable production systems. To enrich textual representations automatically, Gemini 3 was employed to generate descriptive keywords for the training dataset, which were subsequently converted into text embeddings and integrated with image data during model training. Compared with YOLOv8l, which achieved 91.0% AP@50 and 72.2% AP@50:95, text label-based Grounding DINO and YOLO-World demonstrated comparable in-season performance, achieving 91.3% AP@50 and 73.1% AP@50:95, and 91.0% AP@50 and 72.5% AP@50:95, respectively. In contrast, keyword-based prompts resulted in inferior performance for all three VLMs. Grounding DINO achieved the best cross-season generalization performance, with 60.9% and 45.6% AP@50 on the 2021–2023 and 2024 datasets, respectively, improving AP@50 by 12.1% and 7.7% over YOLOv8l (48.8% and 37.9% AP@50, respectively). These results suggest that the benefits of current large-scale VLMs are limited and conditional. While Grounding DINO provides advantages in cross-season generalization, YOLO-World and Qwen3-VL do not consistently improve performance, and enriched descriptions may even negatively affect model performance. The software programs developed in this study have been made publicly available to support future research and development in precision weed management.
Förderung
- Michigan Department of Agriculture & Rural Development
- USDA Agricultural Marketing Service
Zitieren
APA
Deng, B., & Lu, Y. (2026). Toward generalizable crop-weed detection with vision-language models. Smart Agricultural Technology, 15, 102512. https://doi.org/10.1016/j.atech.2026.102512
Vancouver
Deng B, Lu Y. Toward generalizable crop-weed detection with vision-language models. Smart Agricultural Technology. 2026;15:102512. doi:10.1016/j.atech.2026.102512
BibTeX
@article{Deng2026,
author = {Deng, Boyang and Lu, Yuzhen},
title = {Toward generalizable crop-weed detection with vision-language models},
journal = {Smart Agricultural Technology},
year = {2026},
volume = {15},
pages = {102512},
doi = {10.1016/j.atech.2026.102512}
}
EUVIMED