EUVIMEDEUVIMED entdecken
Crossref

HyperMamba: A Spectral-Spatial Adaptive Mamba for Hyperspectral Image Classification

Qiang Liu, Jun Yue, Yi Fang, Shaobo Xia, Leyuan Fang

IEEE Transactions on Geoscience and Remote Sensing · 2024 · 62 · 1-14

DOI: 10.1109/tgrs.2024.3482473 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2024. Verfasst von Qiang Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 68-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Science and Technology Plan Project Fund of Hunan Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transformers have significantly advanced hyperspectral image (HSI) classification through their proficiency in modeling long sequences. However, the high dimensionality of HSIs poses a particular challenge for Transformers due to their quadratic computational complexity. In natural language processing, state-space models (SSMs) such as Mamba hold great promise for handling long sequence tasks with significantly reduced computational overhead. However, the original Mamba lacks consideration for the spectral and spatial information inherent in HSIs. Inspired by this, we propose the HyperMamba, a novel spectral-spatial adaptive Mamba for HSI classification. The core idea of HyperMamba involves adaptively scanning spatial neighborhood pixels and dynamically enhancing spectral bands for spectral scanning based on acquired spatial neighborhood information. Specifically, HyperMamba consists of two core modules: the spatial neighborhood adaptive scanning (SNAS) module and the spectral adaptive enhancement scanning (SAES) module. Initially, the SNAS module analyzes the spectral characteristics of classified pixels, adaptively selecting the optimal neighborhood for spatial scanning by balancing spatial neighborhood information and local spatial structure. Subsequently, the SAES module dynamically enhances the spectral features of classified pixels using neighborhood spectral information and conducts spectral scanning. Finally, the spectral features of the target pixels are fed into a single fully connected layer classifier, achieving high-precision HSI classification. Extensive experiments demonstrate the effectiveness of HyperMamba, surpassing state-of-the-art methods across three widely used HSI datasets. The code will be available at https://github.com/chiangliu/HyperMamba.

Förderung

  • National Natural Science Foundation of China
  • Science and Technology Plan Project Fund of Hunan Province

Zitieren

APA

Liu, Q., Yue, J., Fang, Y., Xia, S., & Fang, L. (2024). HyperMamba: A Spectral-Spatial Adaptive Mamba for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 62, 1-14. https://doi.org/10.1109/tgrs.2024.3482473

Vancouver

Liu Q, Yue J, Fang Y, Xia S, Fang L. HyperMamba: A Spectral-Spatial Adaptive Mamba for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing. 2024;62:1-14. doi:10.1109/tgrs.2024.3482473

BibTeX
@article{Liu2024,
  author = {Liu, Qiang and Yue, Jun and Fang, Yi and Xia, Shaobo and Fang, Leyuan},
  title = {HyperMamba: A Spectral-Spatial Adaptive Mamba for Hyperspectral Image Classification},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  year = {2024},
  volume = {62},
  pages = {1--14},
  doi = {10.1109/tgrs.2024.3482473}
}
Kostenlos starten →