Mamba-STFM: A Mamba-Based Spatiotemporal Fusion Method for Remote Sensing Images
Remote Sensing · 21.06.2025 · 17 (13) · 2135
DOI: 10.3390/rs17132135 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 21.06.2025. Verfasst von Qiyuan Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: major science and technology project of Qinghai Province.
Abstract (Originalsprache)
Spatiotemporal fusion techniques can generate remote sensing imagery with high spatial and temporal resolutions, thereby facilitating Earth observation. However, traditional methods are constrained by linear assumptions; generative adversarial networks suffer from mode collapse; convolutional neural networks struggle to capture global context; and Transformers are hard to scale due to quadratic computational complexity and high memory consumption. To address these challenges, this study introduces an end-to-end remote sensing image spatiotemporal fusion approach based on the Mamba architecture (Mamba-spatiotemporal fusion model, Mamba-STFM), marking the first application of Mamba in this domain and presenting a novel paradigm for spatiotemporal fusion model design. Mamba-STFM consists of a feature extraction encoder and a feature fusion decoder. At the core of the encoder is the visual state space-FuseCore-AttNet block (VSS-FCAN block), which deeply integrates linear complexity cross-scan global perception with a channel attention mechanism, significantly reducing quadratic-level computation and memory overhead while improving inference throughput through parallel scanning and kernel fusion techniques. The decoder’s core is the spatiotemporal mixture-of-experts fusion module (STF-MoE block), composed of our novel spatial expert and temporal expert modules. The spatial expert adaptively adjusts channel weights to optimize spatial feature representation, enabling precise alignment and fusion of multi-resolution images, while the temporal expert incorporates a temporal squeeze-and-excitation mechanism and selective state space model (SSM) techniques to efficiently capture short-range temporal dependencies, maintain linear sequence modeling complexity, and further enhance overall spatiotemporal fusion throughput. Extensive experiments on public datasets demonstrate that Mamba-STFM outperforms existing methods in fusion quality; ablation studies validate the effectiveness of each core module; and efficiency analyses and application comparisons further confirm the model’s superior performance.
Förderung
- major science and technology project of Qinghai Province
Zitieren
APA
Zhang, Q., Zhang, X., Quan, C., Zhao, T., Huo, W., & Huang, Y. (2025). Mamba-STFM: A Mamba-Based Spatiotemporal Fusion Method for Remote Sensing Images. Remote Sensing, 17(13), 2135. https://doi.org/10.3390/rs17132135
Vancouver
Zhang Q, Zhang X, Quan C, Zhao T, Huo W, Huang Y. Mamba-STFM: A Mamba-Based Spatiotemporal Fusion Method for Remote Sensing Images. Remote Sensing. 2025;17(13):2135. doi:10.3390/rs17132135
BibTeX
@article{Zhang2025,
author = {Zhang, Qiyuan and Zhang, Xiaodan and Quan, Chen and Zhao, Tong and Huo, Wei and Huang, Yuanchen},
title = {Mamba-STFM: A Mamba-Based Spatiotemporal Fusion Method for Remote Sensing Images},
journal = {Remote Sensing},
year = {2025},
volume = {17},
number = {13},
pages = {2135},
doi = {10.3390/rs17132135}
}
EUVIMED