S3L: Spectrum Transformer for Self-Supervised Learning in Hyperspectral Image Classification
Remote Sensing · 10.03.2024 · 16 (6) · 970
DOI: 10.3390/rs16060970 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 10.03.2024. Verfasst von Hufeng Guo und 1 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Innovative Research Group Project of the National Science Foundation of China, National Science Foundation of Shanxi Province, Fundamental Research Program of Shanxi Province.
Abstract (Originalsprache)
In the realm of Earth observation and remote sensing data analysis, the advancement of hyperspectral imaging (HSI) classification technology is of paramount importance. Nevertheless, the intricate nature of hyperspectral data, coupled with the scarcity of labeled data, presents significant challenges in this domain. To mitigate these issues, we introduce a self-supervised learning algorithm predicated on a spectral transformer for HSI classification under conditions of limited labeled data, with the objective of enhancing the efficacy of HSI classification. The S3L algorithm operates in two distinct phases: pretraining and fine-tuning. During the pretraining phase, the algorithm learns the spatial representation of HSI from unlabeled data, utilizing a masking mechanism and a spectral transformer, thereby augmenting the sequence dependence of spectral features. Subsequently, in the fine-tuning phase, labeled data is employed to refine the pretrained weights, thereby improving the precision of HSI classification. Within the comprehensive encoder–decoder framework, we propose a novel spectral transformer module specifically engineered to synergize spatial feature extraction with spectral domain analysis. This innovative module adeptly navigates the complex interplay among various spectral bands, capturing both global and sequential spectral dependencies. Uniquely, it incorporates a gated recurrent unit (GRU) layer within the encoder to enhance its ability to process spectral sequences. Our experimental evaluations across several public datasets reveal that our proposed method, distinguished by its spectral transformer, achieves superior classification performance, particularly in scenarios with limited labeled samples, outperforming existing state-of-the-art approaches.
Förderung
- Innovative Research Group Project of the National Science Foundation of China
- National Science Foundation of Shanxi Province
- Fundamental Research Program of Shanxi Province
Zitieren
APA
Guo, H., & Liu, W. (2024). S3L: Spectrum Transformer for Self-Supervised Learning in Hyperspectral Image Classification. Remote Sensing, 16(6), 970. https://doi.org/10.3390/rs16060970
Vancouver
Guo H, Liu W. S3L: Spectrum Transformer for Self-Supervised Learning in Hyperspectral Image Classification. Remote Sensing. 2024;16(6):970. doi:10.3390/rs16060970
BibTeX
@article{Guo2024,
author = {Guo, Hufeng and Liu, Wenyi},
title = {S3L: Spectrum Transformer for Self-Supervised Learning in Hyperspectral Image Classification},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {6},
pages = {970},
doi = {10.3390/rs16060970}
}
EUVIMED