EUVIMEDEUVIMED entdecken
Crossref

Interactive Spectral-Spatial Transformer for Hyperspectral Image Classification

Liangliang Song, Zhixi Feng, Shuyuan Yang, Xinyu Zhang, Licheng Jiao

IEEE Transactions on Circuits and Systems for Video Technology · 2024-09 · 34 (9) · 8589-8601

DOI: 10.1109/tcsvt.2024.3386578 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-09. Verfasst von Liangliang Song und 4 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 60 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Science and Technology Program of Guangzhou, China, China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The abundant spectral signatures and spatial contexts are effectively utilized as the key to hyperspectral image (HSI) classification. Existing convolutional neural networks (CNNs), only focus on locally spatial context information and lack the ability to learn global spectral sequence representations, whereas the transformer performs well in learning the global dependence of sequential data. To solve this issue, inspired by the transformer, we propose an interactive global spectral and local spatial feature fusion transformer called ISSFormer. Specifically, we achieve an elegant integration of self-attention and convolution in a parallel design, i.e., the multi-head self-attention mechanism (MHSA) and the local spatial perception mechanism (LSP). ISSFormer can learn both local spatial feature representation and global spectral feature representation simultaneously. More significantly, we propose a bi-directional interaction mechanism (BIM) of features across the parallel branch to provide complementary clues. The local spatial features and the global spectral features interact through the BIM which could emphasize the local spatial details and add spatial constraints to overcome spectral variability, and can further improve classification performance. With extensive experiments on three benchmark datasets, including Indian Pines, Pavia University, and WHU-Hi-HanChuan, ISSFormer can accomplish superior classification accuracy and visualization performance.

Förderung

  • National Natural Science Foundation of China
  • Science and Technology Program of Guangzhou, China
  • China Postdoctoral Science Foundation

Zitieren

APA

Song, L., Feng, Z., Yang, S., Zhang, X., & Jiao, L. (2024). Interactive Spectral-Spatial Transformer for Hyperspectral Image Classification. IEEE Transactions on Circuits and Systems for Video Technology, 34(9), 8589-8601. https://doi.org/10.1109/tcsvt.2024.3386578

Vancouver

Song L, Feng Z, Yang S, Zhang X, Jiao L. Interactive Spectral-Spatial Transformer for Hyperspectral Image Classification. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(9):8589-8601. doi:10.1109/tcsvt.2024.3386578

BibTeX
@article{Song2024,
  author = {Song, Liangliang and Feng, Zhixi and Yang, Shuyuan and Zhang, Xinyu and Jiao, Licheng},
  title = {Interactive Spectral-Spatial Transformer for Hyperspectral Image Classification},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {9},
  pages = {8589--8601},
  doi = {10.1109/tcsvt.2024.3386578}
}
Kostenlos starten →