Vision Meets Language: A RAG-Augmented YOLOv8 Framework for Coffee Disease Diagnosis and Farmer Assistance
SN Computer Science · 30.07.2026 · 7 (6)
DOI: 10.1007/s42979-026-05246-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift SN Computer Science, online erschienen am 30.07.2026. Verfasst von Semanto Mondal und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Università degli Studi di Napoli Federico II.
Abstract (Originalsprache)
Timely and accurate identification of crop diseases is a critical challenge in precision agriculture, as delayed or incorrect diagnosis often leads to excessive pesticide use, yield loss, and environmental degradation. Existing vision-based disease detection systems primarily focus on classification accuracy but lack interpretability and decision support, while large language models (LLMs) suffer from hallucinations when deployed without domain grounding. To address these limitations, this paper proposes a knowledge-grounded vision–language framework that connects YOLOv8-based disease detection with a Retrieval-Augmented Generation (RAG) pipeline and a Large Language Model (LLM). The framework transforms structured visual detection outputs into retrieval queries that guide knowledge-grounded reasoning, enabling fact-consistent explanations and disease-specific remediation recommendations while mitigating hallucinations. Experiments conducted on the BRACOL coffee leaf dataset demonstrate that the proposed system achieves strong detection performance using YOLOv8n, attaining an overall mAP@0.5 of 0.792 and mAP@0.5:0.95 of 0.523 on the original annotations. Compared to refined annotations, the original dataset yields consistent performance gains across all disease classes, highlighting the sensitivity of detection models to annotation strictness. Furthermore, a Non-Maximum Suppression (NMS) based ensemble of multiple YOLO variants improves robustness on challenging classes, increasing mAP@0.5 from 0.619 (best single model) to 0.634 on the reviewed dataset. By combining accurate visual detection with knowledge-grounded language generation, the proposed framework provides an interpretable, user-friendly decision support tool for farmers. This work demonstrates the potential of integrating object detection, RAG, and LLMs to support sustainable, data-driven disease management and reduce unnecessary pesticide usage in precision agriculture.
Förderung
- Università degli Studi di Napoli Federico II
Zitieren
APA
Mondal, S., Ferraro, A., Pecorelli, F., Iammarino, M., & Pietro, G. D. (2026). Vision Meets Language: A RAG-Augmented YOLOv8 Framework for Coffee Disease Diagnosis and Farmer Assistance. SN Computer Science, 7(6). https://doi.org/10.1007/s42979-026-05246-4
Vancouver
Mondal S, Ferraro A, Pecorelli F, Iammarino M, Pietro GD. Vision Meets Language: A RAG-Augmented YOLOv8 Framework for Coffee Disease Diagnosis and Farmer Assistance. SN Computer Science. 2026;7(6). doi:10.1007/s42979-026-05246-4
BibTeX
@article{Mondal2026,
author = {Mondal, Semanto and Ferraro, Antonino and Pecorelli, Fabiano and Iammarino, Martina and Pietro, Giuseppe De},
title = {Vision Meets Language: A RAG-Augmented YOLOv8 Framework for Coffee Disease Diagnosis and Farmer Assistance},
journal = {SN Computer Science},
year = {2026},
volume = {7},
number = {6},
doi = {10.1007/s42979-026-05246-4}
}
EUVIMED