MultiScale spectral–spatial convolutional transformer for hyperspectral image classification
IET Image Processing · 2024-11 · 18 (13) · 4328-4340
DOI: 10.1049/ipr2.13254 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 10.10.2024. Verfasst von Zhiqiang Gong und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Due to the powerful ability in capturing the global information, transformer has become an alternative architecture of CNNs for hyperspectral image classification. However, general transformer mainly considers the global spectral information while ignores the multiscale spatial information of the hyperspectral image. In this paper, we propose a multiscale spectral–spatial convolutional transformer (MultiFormer) for hyperspectral image classification. First, the developed method utilizes multiscale spatial patches as tokens to formulate the spatial transformer and generates multiscale spatial representation of each band in each pixel. Second, the spatial representation of all the bands in a given pixel are utilized as tokens to formulate the spectral transformer and generate the multiscale spectral–spatial representation of each pixel. Besides, a modified spectral–spatial CAF module is constructed in the MultiFormer to fuse cross‐layer spectral and spatial information. Therefore, the proposed MultiFormer can capture the multiscale spectral–spatial information and provide better performance than most of other architectures for hyperspectral image classification. Experiments are conducted over commonly used real‐world datasets and the comparison results show the superiority of the proposed method.
Zitieren
APA
Gong, Z., Zhou, X., & Yao, W. (2024). MultiScale spectral–spatial convolutional transformer for hyperspectral image classification. IET Image Processing, 18(13), 4328-4340. https://doi.org/10.1049/ipr2.13254
Vancouver
Gong Z, Zhou X, Yao W. MultiScale spectral–spatial convolutional transformer for hyperspectral image classification. IET Image Processing. 2024;18(13):4328-4340. doi:10.1049/ipr2.13254
BibTeX
@article{Gong2024,
author = {Gong, Zhiqiang and Zhou, Xian and Yao, Wen},
title = {MultiScale spectral–spatial convolutional transformer for hyperspectral image classification},
journal = {IET Image Processing},
year = {2024},
volume = {18},
number = {13},
pages = {4328--4340},
doi = {10.1049/ipr2.13254}
}
EUVIMED