EUVIMEDEUVIMED entdecken
Crossref

HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification

Yan He, Bing Tu, Bo Liu, Jun Li, Antonio Plaza

IEEE Transactions on Geoscience and Remote Sensing · 2025 · 63 · 1-16

DOI: 10.1109/tgrs.2025.3564167 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2025. Verfasst von Yan He und 4 weiteren Autor:innen. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Start-Up Foundation for Introducing Talent of Nanjing University of Information Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hyperspectral image (HSI) classification is fundamental to numerous remote sensing applications, enabling detailed analysis of material properties and environmental conditions. Recent Mamba built upon selective state space models (SSMs) (S6) have demonstrated exceptional advantages in long-range sequence modeling with linear computational efficiency, while Transformer based on self-attention mechanisms is particularly adept at capturing short-range dependencies. To leverage the complementary strengths of these models, this article introduces a novel hybrid Mamba-Transformer framework (HSI-MFormer), effectively exploring the multiscale properties of hyperspectral data for HSI classification. Initially, a multiscale token generation (MTG) module is developed, which converts the HSI cube into multiple spatial-spectral token groups across different scales. To adequately capture fine-grained multiscale spatial-spectral patterns, an inner-scale transformer expert (ITE) is designed, which incorporates grouped self-attention operations to perform short-range sequence modeling within token groups at each scale. Meanwhile, a cross-scale Mamba expert (CME) is introduced, which integrates a cross-scale serialization mechanism and bidirectional Mamba block for long-range sequence modeling, further exploring the interactions and complementarity between token groups across different scales. Several hybrid strategies for integrating the ITE and CME are investigated to maximize their complementarity, including parallel, interval, and serial structures. Extensive experiments demonstrate that the proposed HSI-MFormer significantly outperforms the state-of-the-art Transformer-based and Mamba-based HSI classification methods. The code is available at http://github.com/tubingnuist/HSI-MFormer.

Förderung

  • National Natural Science Foundation of China
  • Start-Up Foundation for Introducing Talent of Nanjing University of Information Science and Technology

Zitieren

APA

He, Y., Tu, B., Liu, B., Li, J., & Plaza, A. (2025). HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 63, 1-16. https://doi.org/10.1109/tgrs.2025.3564167

Vancouver

He Y, Tu B, Liu B, Li J, Plaza A. HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing. 2025;63:1-16. doi:10.1109/tgrs.2025.3564167

BibTeX
@article{He2025,
  author = {He, Yan and Tu, Bing and Liu, Bo and Li, Jun and Plaza, Antonio},
  title = {HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  year = {2025},
  volume = {63},
  pages = {1--16},
  doi = {10.1109/tgrs.2025.3564167}
}
Kostenlos starten →