EUVIMEDEUVIMED entdecken
Crossref

3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification

Yan He, Bing Tu, Bo Liu, Jun Li, Antonio Plaza

IEEE Transactions on Geoscience and Remote Sensing · 2024 · 62 · 1-16

DOI: 10.1109/tgrs.2024.3472091 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2024. Verfasst von Yan He und 4 weiteren Autor:innen. Die Arbeit wurde bisher 141-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Start-Up Foundation for Introducing Talent of Nanjing University of Information Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional neural networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual dependencies. However, these architectures suffer from limited receptive fields and quadratic computational complexity, respectively. Fortunately, recent Mamba architectures built upon the state space models (SSMs) integrate the advantages of long-range sequence modeling and linear computational efficiency, exhibiting substantial potential in low-dimensional scenarios. Motivated by this, we propose a novel 3D-spectral-spatial mamba (3DSS-Mamba) framework for HSI classification, allowing for global spectral-spatial relationship modeling with greater computational efficiency. Technically, a spectral-spatial token generation (SSTG) module is designed to convert the HSI cube into a set of 3-D spectral-spatial tokens. To overcome the limitations of traditional Mamba, which is confined to modeling causal sequences and inadaptable to high-dimensional scenarios, a 3D-spectral-spatial selective scanning (3DSS) mechanism is introduced, which performs pixel-wise selective scanning on 3-D hyperspectral tokens along the spectral and spatial dimensions. Five scanning routes are constructed to investigate the impact of dimension prioritization. The 3DSS scanning mechanism combined with conventional mapping operations forms the 3D-spectral-spatial mamba block (3DMB), enabling the extraction of global spectral-spatial semantic representations. Experimental results and analysis demonstrate that the proposed method outperforms the state-of-the-art methods on HSI classification benchmarks. The code is available at https://github.com/IIP-Team/3DSS-Mamba.

Förderung

  • National Natural Science Foundation of China
  • Start-Up Foundation for Introducing Talent of Nanjing University of Information Science and Technology

Zitieren

APA

He, Y., Tu, B., Liu, B., Li, J., & Plaza, A. (2024). 3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 62, 1-16. https://doi.org/10.1109/tgrs.2024.3472091

Vancouver

He Y, Tu B, Liu B, Li J, Plaza A. 3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing. 2024;62:1-16. doi:10.1109/tgrs.2024.3472091

BibTeX
@article{He2024,
  author = {He, Yan and Tu, Bing and Liu, Bo and Li, Jun and Plaza, Antonio},
  title = {3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  year = {2024},
  volume = {62},
  pages = {1--16},
  doi = {10.1109/tgrs.2024.3472091}
}
Kostenlos starten →