ConvMambaSR: Leveraging State-Space Models and CNNs in a Dual-Branch Architecture for Remote Sensing Imagery Super-Resolution
Remote Sensing · 02.09.2024 · 16 (17) · 3254
DOI: 10.3390/rs16173254 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 02.09.2024. Verfasst von Qiwei Zhu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Qinghai Province, National Natural Science Foundation of China, High-performance Computing Center of Qinghai University.
Abstract (Originalsprache)
Deep learning-based super-resolution (SR) techniques play a crucial role in enhancing the spatial resolution of images. However, remote sensing images present substantial challenges due to their diverse features, complex structures, and significant size variations in ground objects. Moreover, recovering lost details from low-resolution remote sensing images with complex and unknown degradations, such as downsampling, noise, and compression, remains a critical issue. To address these challenges, we propose ConvMambaSR, a novel super-resolution framework that integrates state-space models (SSMs) and Convolutional Neural Networks (CNNs). This framework is specifically designed to handle heterogeneous and complex ground features, as well as unknown degradations in remote sensing imagery. ConvMambaSR leverages SSMs to model global dependencies, activating more pixels in the super-resolution task. Concurrently, it employs CNNs to extract local detail features, enhancing the model’s ability to capture image textures and edges. Furthermore, we have developed a global–detail reconstruction module (GDRM) to integrate diverse levels of global and local information efficiently. We rigorously validated the proposed method on two distinct datasets, RSSCN7 and RSSRD-KQ, and benchmarked its performance against state-of-the-art SR models. Experiments show that our method achieves SOTA PSNR values of 26.06 and 24.29 on these datasets, respectively, and is visually superior, effectively addressing a variety of scenarios and significantly outperforming existing methods.
Förderung
- Natural Science Foundation of Qinghai Province
- National Natural Science Foundation of China
- High-performance Computing Center of Qinghai University
Zitieren
APA
Zhu, Q., Zhang, G., Zou, X., Wang, X., Huang, J., & Li, X. (2024). ConvMambaSR: Leveraging State-Space Models and CNNs in a Dual-Branch Architecture for Remote Sensing Imagery Super-Resolution. Remote Sensing, 16(17), 3254. https://doi.org/10.3390/rs16173254
Vancouver
Zhu Q, Zhang G, Zou X, Wang X, Huang J, Li X. ConvMambaSR: Leveraging State-Space Models and CNNs in a Dual-Branch Architecture for Remote Sensing Imagery Super-Resolution. Remote Sensing. 2024;16(17):3254. doi:10.3390/rs16173254
BibTeX
@article{Zhu2024,
author = {Zhu, Qiwei and Zhang, Guojing and Zou, Xuechao and Wang, Xiaoying and Huang, Jianqiang and Li, Xilai},
title = {ConvMambaSR: Leveraging State-Space Models and CNNs in a Dual-Branch Architecture for Remote Sensing Imagery Super-Resolution},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {17},
pages = {3254},
doi = {10.3390/rs16173254}
}
EUVIMED