EUVIMEDEUVIMED entdecken
Crossref

LVM-StARS: Large Vision Model Soft Adaption for Remote Sensing Scene Classification

Bohan Yang, Yushi Chen, Pedram Ghamisi

IEEE Geoscience and Remote Sensing Letters · 2024 · 21 · 1-5

DOI: 10.1109/lgrs.2024.3432069 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Geoscience and Remote Sensing Letters, 2024. Verfasst von Bohan Yang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 28 Literaturangaben. Gefördert von: Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recently, both large language models and large vision models (LVMs) have gained significant attention. Trained on large-scale datasets, these large models have showcased remarkable capabilities across various research domains. To enhance the accuracy of remote sensing (RS) scene classification, LVM-based methods are explored in this letter. Due to the differences between RS images and natural images, simply transferring LVMs to RS tasks is impractical. Therefore, we conducted research on relevant techniques and appended learnable prompt tokens to the input tokens while freezing the backbone weights, reducing the parameter scale and making the LVM weights easier to harness and to transfer. In consideration of latent catastrophic forgetting issues induced by ordinary finetuning techniques and the inherent complexity and redundancy of RS images, we introduced soft adaption mechanisms between backbone layers based on prompt tuning technique and implemented the first LVM tuning method, namely, the Large Vision Model Soft Adaption for RS scene classification (LVM-StARS)-Deep and the LVM-StARS-Shallow to make LVMs more suitable for RS scene classification tasks. The proposed methods are evaluated on two popular RS scene classification datasets, and the experimental results indicate that the proposed method outperforms other state-of-the-art methods. The experimental results demonstrate that our proposed method enhances overall accuracy (OA) by 1.71%–3.94%, while updating only 0.1%–0.5% of the parameters compared to full finetuning. Furthermore, our method outperforms the existing methods.

Förderung

  • Natural Science Foundation of China

Zitieren

APA

Yang, B., Chen, Y., & Ghamisi, P. (2024). LVM-StARS: Large Vision Model Soft Adaption for Remote Sensing Scene Classification. IEEE Geoscience and Remote Sensing Letters, 21, 1-5. https://doi.org/10.1109/lgrs.2024.3432069

Vancouver

Yang B, Chen Y, Ghamisi P. LVM-StARS: Large Vision Model Soft Adaption for Remote Sensing Scene Classification. IEEE Geoscience and Remote Sensing Letters. 2024;21:1-5. doi:10.1109/lgrs.2024.3432069

BibTeX
@article{Yang2024,
  author = {Yang, Bohan and Chen, Yushi and Ghamisi, Pedram},
  title = {LVM-StARS: Large Vision Model Soft Adaption for Remote Sensing Scene Classification},
  journal = {IEEE Geoscience and Remote Sensing Letters},
  year = {2024},
  volume = {21},
  pages = {1--5},
  doi = {10.1109/lgrs.2024.3432069}
}
Kostenlos starten →