HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification
IEEE Transactions on Geoscience and Remote Sensing · 2025 · 63 · 1-16
DOI: 10.1109/tgrs.2025.3564167 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2025. Verfasst von Yan He und 4 weiteren Autor:innen. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Start-Up Foundation for Introducing Talent of Nanjing University of Information Science and Technology.
Abstract (Originalsprache)
Hyperspectral image (HSI) classification is fundamental to numerous remote sensing applications, enabling detailed analysis of material properties and environmental conditions. Recent Mamba built upon selective state space models (SSMs) (S6) have demonstrated exceptional advantages in long-range sequence modeling with linear computational efficiency, while Transformer based on self-attention mechanisms is particularly adept at capturing short-range dependencies. To leverage the complementary strengths of these models, this article introduces a novel hybrid Mamba-Transformer framework (HSI-MFormer), effectively exploring the multiscale properties of hyperspectral data for HSI classification. Initially, a multiscale token generation (MTG) module is developed, which converts the HSI cube into multiple spatial-spectral token groups across different scales. To adequately capture fine-grained multiscale spatial-spectral patterns, an inner-scale transformer expert (ITE) is designed, which incorporates grouped self-attention operations to perform short-range sequence modeling within token groups at each scale. Meanwhile, a cross-scale Mamba expert (CME) is introduced, which integrates a cross-scale serialization mechanism and bidirectional Mamba block for long-range sequence modeling, further exploring the interactions and complementarity between token groups across different scales. Several hybrid strategies for integrating the ITE and CME are investigated to maximize their complementarity, including parallel, interval, and serial structures. Extensive experiments demonstrate that the proposed HSI-MFormer significantly outperforms the state-of-the-art Transformer-based and Mamba-based HSI classification methods. The code is available at http://github.com/tubingnuist/HSI-MFormer.
Förderung
- National Natural Science Foundation of China
- Start-Up Foundation for Introducing Talent of Nanjing University of Information Science and Technology
Zitieren
APA
He, Y., Tu, B., Liu, B., Li, J., & Plaza, A. (2025). HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 63, 1-16. https://doi.org/10.1109/tgrs.2025.3564167
Vancouver
He Y, Tu B, Liu B, Li J, Plaza A. HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing. 2025;63:1-16. doi:10.1109/tgrs.2025.3564167
BibTeX
@article{He2025,
author = {He, Yan and Tu, Bing and Liu, Bo and Li, Jun and Plaza, Antonio},
title = {HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification},
journal = {IEEE Transactions on Geoscience and Remote Sensing},
year = {2025},
volume = {63},
pages = {1--16},
doi = {10.1109/tgrs.2025.3564167}
}
EUVIMED