An intelligent multi-modal Q&A system for agriculture combining APGM, PBTCS, and RAG
Smart Agricultural Technology · 2026-03 · 13 · 101829
DOI: 10.1016/j.atech.2026.101829 ↗Kurz gefasst
Fachartikel in der Zeitschrift Smart Agricultural Technology, 2026-03. Verfasst von Baihan Liu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 14 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China, Special Project for Research and Development in Key areas of Guangdong Province.
Abstract (Originalsprache)
This study addresses the growing need for efficient large-scale modeling techniques in agricultural production by introducing an intelligent multimodal question-answering system tailored to fruit tree cultivation. At its core is a lightweight multimodal prompt-generation model (APGM), which integrates a CLIP-based visual encoder with a Transformer-based text encoder and employs dual-path cross-attention and dynamic weight fusion for effective cross-modal representation. To further enhance system performance, we construct a domain-specific knowledge base with retrieval-augmented generation (RAG) and propose a Problem-Based Tiered Control Strategy (PBTCS) that allocates language models of different scales according to task complexity, balancing accuracy with computational cost. Experimental results show that the integrated system—combining APGM, RAG, and PBTCS—substantially outperforms general-purpose large models in pest and disease diagnosis, achieving 85.5% accuracy, a 25% increase in inference speed, and over a 50% reduction in GPU memory usage. Ablation studies confirm the synergy between APGM and RAG, with F1 scores improving by up to 18.8% on medium and high-difficulty queries and memory usage decreasing from 31.3 GB to 15.3 GB. This work provides a lightweight, cost-effective, and domain-optimized solution for agricultural question-answering systems.
Förderung
- National Natural Science Foundation of China
- Special Project for Research and Development in Key areas of Guangdong Province
Zitieren
APA
Liu, B., Zhang, Y., Liu, Y., Deng, X., Qing, J., Han, B., Meng, X., Lan, Y., & Qiu, H. (2026). An intelligent multi-modal Q&A system for agriculture combining APGM, PBTCS, and RAG. Smart Agricultural Technology, 13, 101829. https://doi.org/10.1016/j.atech.2026.101829
Vancouver
Liu B, Zhang Y, Liu Y, Deng X, Qing J, Han B, et al. An intelligent multi-modal Q&A system for agriculture combining APGM, PBTCS, and RAG. Smart Agricultural Technology. 2026;13:101829. doi:10.1016/j.atech.2026.101829
BibTeX
@article{Liu2026,
author = {Liu, Baihan and Zhang, Yi and Liu, Yongshun and Deng, Xiaoling and Qing, Jiajun and Han, Bo and Meng, Xiangbao and Lan, Yubin and Qiu, Haofeng},
title = {An intelligent multi-modal Q&A system for agriculture combining APGM, PBTCS, and RAG},
journal = {Smart Agricultural Technology},
year = {2026},
volume = {13},
pages = {101829},
doi = {10.1016/j.atech.2026.101829}
}
EUVIMED