EUVIMEDEUVIMED entdecken
Crossref

Quantitative regularization in robust vision transformer for remote sensing image classification

Huaxiang Song, Yuxuan Yuan, Zhiwei Ouyang, Yu Yang, Hui Xiang

The Photogrammetric Record · 2024-06 · 39 (186) · 340-372

DOI: 10.1111/phor.12489 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Photogrammetric Record, online erschienen am 24.04.2024. Verfasst von Huaxiang Song und 4 weiteren Autor:innen. Die Arbeit wurde bisher 81-mal zitiert (Crossref) und nennt 59 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision Transformers (ViTs) are exceptional at vision tasks. However, when applied to remote sensing images (RSIs), existing methods often necessitate extensive modifications of ViTs to rival convolutional neural networks (CNNs). This requirement significantly impedes the application of ViTs in geosciences, particularly for researchers who lack the time for comprehensive model redesign. To address this issue, we introduce the concept of quantitative regularization (QR), designed to enhance the performance of ViTs in RSI classification. QR represents an effective algorithm that adeptly manages domain discrepancies in RSIs and can be integrated with any ViTs in transfer learning. We evaluated the effectiveness of QR using three ViT architectures: vanilla ViT, Swin‐ViT and Next‐ViT, on four datasets: AID30, NWPU45, AFGR50 and UCM21. The results reveal that our Next‐ViT model surpasses 39 other advanced methods published in the past 3 years, maintaining robust performance even with a limited number of training samples. We also discovered that our ViT and Swin‐ViT achieve significantly higher accuracy and robustness compared to other methods using the same backbone. Our findings confirm that ViTs can be as effective as CNNs for RSI classification, regardless of the dataset size. Our approach exclusively employs open‐source ViTs and easily accessible training strategies. Consequently, we believe that our method can significantly lower the barriers for geoscience researchers intending to use ViT for RSI applications.

Zitieren

APA

Song, H., Yuan, Y., Ouyang, Z., Yang, Y., & Xiang, H. (2024). Quantitative regularization in robust vision transformer for remote sensing image classification. The Photogrammetric Record, 39(186), 340-372. https://doi.org/10.1111/phor.12489

Vancouver

Song H, Yuan Y, Ouyang Z, Yang Y, Xiang H. Quantitative regularization in robust vision transformer for remote sensing image classification. The Photogrammetric Record. 2024;39(186):340-372. doi:10.1111/phor.12489

BibTeX
@article{Song2024,
  author = {Song, Huaxiang and Yuan, Yuxuan and Ouyang, Zhiwei and Yang, Yu and Xiang, Hui},
  title = {Quantitative regularization in robust vision transformer for remote sensing image classification},
  journal = {The Photogrammetric Record},
  year = {2024},
  volume = {39},
  number = {186},
  pages = {340--372},
  doi = {10.1111/phor.12489}
}
Kostenlos starten →