Interactive Spectral-Spatial Transformer for Hyperspectral Image Classification
IEEE Transactions on Circuits and Systems for Video Technology · 2024-09 · 34 (9) · 8589-8601
DOI: 10.1109/tcsvt.2024.3386578 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-09. Verfasst von Liangliang Song und 4 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 60 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Science and Technology Program of Guangzhou, China, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
The abundant spectral signatures and spatial contexts are effectively utilized as the key to hyperspectral image (HSI) classification. Existing convolutional neural networks (CNNs), only focus on locally spatial context information and lack the ability to learn global spectral sequence representations, whereas the transformer performs well in learning the global dependence of sequential data. To solve this issue, inspired by the transformer, we propose an interactive global spectral and local spatial feature fusion transformer called ISSFormer. Specifically, we achieve an elegant integration of self-attention and convolution in a parallel design, i.e., the multi-head self-attention mechanism (MHSA) and the local spatial perception mechanism (LSP). ISSFormer can learn both local spatial feature representation and global spectral feature representation simultaneously. More significantly, we propose a bi-directional interaction mechanism (BIM) of features across the parallel branch to provide complementary clues. The local spatial features and the global spectral features interact through the BIM which could emphasize the local spatial details and add spatial constraints to overcome spectral variability, and can further improve classification performance. With extensive experiments on three benchmark datasets, including Indian Pines, Pavia University, and WHU-Hi-HanChuan, ISSFormer can accomplish superior classification accuracy and visualization performance.
Förderung
- National Natural Science Foundation of China
- Science and Technology Program of Guangzhou, China
- China Postdoctoral Science Foundation
Zitieren
APA
Song, L., Feng, Z., Yang, S., Zhang, X., & Jiao, L. (2024). Interactive Spectral-Spatial Transformer for Hyperspectral Image Classification. IEEE Transactions on Circuits and Systems for Video Technology, 34(9), 8589-8601. https://doi.org/10.1109/tcsvt.2024.3386578
Vancouver
Song L, Feng Z, Yang S, Zhang X, Jiao L. Interactive Spectral-Spatial Transformer for Hyperspectral Image Classification. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(9):8589-8601. doi:10.1109/tcsvt.2024.3386578
BibTeX
@article{Song2024,
author = {Song, Liangliang and Feng, Zhixi and Yang, Shuyuan and Zhang, Xinyu and Jiao, Licheng},
title = {Interactive Spectral-Spatial Transformer for Hyperspectral Image Classification},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {9},
pages = {8589--8601},
doi = {10.1109/tcsvt.2024.3386578}
}
EUVIMED