EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models

Yueyue Zhou iD, Hongping Yan iD, Kun Ding iD, Tingting Cai, Yan Zhang

Sensors · 21.09.2024 · 24 (18) · 6109

DOI: 10.3390/s24186109 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 21.09.2024. Verfasst von Yueyue Zhou und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Engineering, China University of Geosciences, Beijing 100083, China. Hauptthemen laut MEDLINE: Crops, Agricultural, Algorithms, Plant Diseases. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate crop disease classification is crucial for ensuring food security and enhancing agricultural productivity. However, the existing crop disease classification algorithms primarily focus on a single image modality and typically require a large number of samples. Our research counters these issues by using pre-trained Vision–Language Models (VLMs), which enhance the multimodal synergy for better crop disease classification than the traditional unimodal approaches. Firstly, we apply the multimodal model Qwen-VL to generate meticulous textual descriptions for representative disease images selected through clustering from the training set, which will serve as prompt text for generating classifier weights. Compared to solely using the language model for prompt text generation, this approach better captures and conveys fine-grained and image-specific information, thereby enhancing the prompt quality. Secondly, we integrate cross-attention and SE (Squeeze-and-Excitation) Attention into the training-free mode VLCD(Vision-Language model for Crop Disease classification) and the training-required mode VLCD-T (VLCD-Training), respectively, for prompt text processing, enhancing the classifier weights by emphasizing the key text features. The experimental outcomes conclusively prove our method’s heightened classification effectiveness in few-shot crop disease scenarios, tackling the data limitations and intricate disease recognition issues. It offers a pragmatic tool for agricultural pathology and reinforces the smart farming surveillance infrastructure.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Crops, AgriculturalAlgorithmsPlant DiseasesImage Processing, Computer-Assisted

Stichwörter der Autor:innen

attention mechanismscrop disease classificationfew-shot learningvision–language models

Autor:innen und Institutionen

  • School of Information Engineering, China University of Geosciences, Beijing 100083, China.
  • State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.

ORCID-Profile: Yueyue Zhou, Hongping Yan, Kun Ding

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhou, Y., Yan, H., Ding, K., Cai, T., & Zhang, Y. (2024). Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models. Sensors, 24(18), 6109. https://doi.org/10.3390/s24186109

Vancouver

Zhou Y, Yan H, Ding K, Cai T, Zhang Y. Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models. Sensors. 2024;24(18):6109. doi:10.3390/s24186109

BibTeX
@article{Zhou2024,
  author = {Zhou, Yueyue and Yan, Hongping and Ding, Kun and Cai, Tingting and Zhang, Yan},
  title = {Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {18},
  pages = {6109},
  doi = {10.3390/s24186109}
}
Kostenlos starten →