EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision-Language Models for Zero-Shot Classification of Remote Sensing Images

Mohamad Al Rahhal, Yakoub Bazi, Hebah Elgibreen, Mansour Zuair

Applied Sciences · 17.11.2023 · 13 (22) · 12462

DOI: 10.3390/app132212462 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 17.11.2023. Verfasst von Mohamad Al Rahhal und 3 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: King Saud University, Riyadh, Saudi Arabia.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Zero-shot classification presents a challenge since it necessitates a model to categorize images belonging to classes it has not encountered during its training phase. Previous research in the field of remote sensing (RS) has explored this task by training image-based models on known RS classes and then attempting to predict the outcomes for unfamiliar classes. Despite these endeavors, the outcomes have proven to be less than satisfactory. In this paper, we propose an alternative approach that leverages vision-language models (VLMs), which have undergone pre-training to grasp the associations between general computer vision image-text pairs in diverse datasets. Specifically, our investigation focuses on thirteen VLMs derived from Contrastive Language-Image Pre-Training (CLIP/Open-CLIP) with varying levels of parameter complexity. In our experiments, we ascertain the most suitable prompt for RS images to query the language capabilities of the VLM. Furthermore, we demonstrate that the accuracy of zero-shot classification, particularly when using large CLIP models, on three widely recognized RS scene datasets yields superior results compared to existing RS solutions.

Förderung

  • King Saud University, Riyadh, Saudi Arabia

Zitieren

APA

Rahhal, M. A., Bazi, Y., Elgibreen, H., & Zuair, M. (2023). Vision-Language Models for Zero-Shot Classification of Remote Sensing Images. Applied Sciences, 13(22), 12462. https://doi.org/10.3390/app132212462

Vancouver

Rahhal MA, Bazi Y, Elgibreen H, Zuair M. Vision-Language Models for Zero-Shot Classification of Remote Sensing Images. Applied Sciences. 2023;13(22):12462. doi:10.3390/app132212462

BibTeX
@article{Rahhal2023,
  author = {Rahhal, Mohamad Al and Bazi, Yakoub and Elgibreen, Hebah and Zuair, Mansour},
  title = {Vision-Language Models for Zero-Shot Classification of Remote Sensing Images},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {22},
  pages = {12462},
  doi = {10.3390/app132212462}
}
Kostenlos starten →