Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models
Sensors · 21.09.2024 · 24 (18) · 6109
DOI: 10.3390/s24186109 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 21.09.2024. Verfasst von Yueyue Zhou und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Engineering, China University of Geosciences, Beijing 100083, China. Hauptthemen laut MEDLINE: Crops, Agricultural, Algorithms, Plant Diseases. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Accurate crop disease classification is crucial for ensuring food security and enhancing agricultural productivity. However, the existing crop disease classification algorithms primarily focus on a single image modality and typically require a large number of samples. Our research counters these issues by using pre-trained Vision–Language Models (VLMs), which enhance the multimodal synergy for better crop disease classification than the traditional unimodal approaches. Firstly, we apply the multimodal model Qwen-VL to generate meticulous textual descriptions for representative disease images selected through clustering from the training set, which will serve as prompt text for generating classifier weights. Compared to solely using the language model for prompt text generation, this approach better captures and conveys fine-grained and image-specific information, thereby enhancing the prompt quality. Secondly, we integrate cross-attention and SE (Squeeze-and-Excitation) Attention into the training-free mode VLCD(Vision-Language model for Crop Disease classification) and the training-required mode VLCD-T (VLCD-Training), respectively, for prompt text processing, enhancing the classifier weights by emphasizing the key text features. The experimental outcomes conclusively prove our method’s heightened classification effectiveness in few-shot crop disease scenarios, tackling the data limitations and intricate disease recognition issues. It offers a pragmatic tool for agricultural pathology and reinforces the smart farming surveillance infrastructure.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Information Engineering, China University of Geosciences, Beijing 100083, China.
- State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
ORCID-Profile: Yueyue Zhou, Hongping Yan, Kun Ding
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zhou, Y., Yan, H., Ding, K., Cai, T., & Zhang, Y. (2024). Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models. Sensors, 24(18), 6109. https://doi.org/10.3390/s24186109
Vancouver
Zhou Y, Yan H, Ding K, Cai T, Zhang Y. Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models. Sensors. 2024;24(18):6109. doi:10.3390/s24186109
BibTeX
@article{Zhou2024,
author = {Zhou, Yueyue and Yan, Hongping and Ding, Kun and Cai, Tingting and Zhang, Yan},
title = {Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models},
journal = {Sensors},
year = {2024},
volume = {24},
number = {18},
pages = {6109},
doi = {10.3390/s24186109}
}
EUVIMED