An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution
Remote Sensing · 01.03.2024 · 16 (5) · 880
DOI: 10.3390/rs16050880 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 01.03.2024. Verfasst von Wenjian Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 50-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Program Project of Science and Technology Innovation of the Chinese Academy of Sciences, Innovation Foundation of Key Laboratory of Computational Optical Imaging Technology, CAS.
Abstract (Originalsprache)
Transformer models have great potential in the field of remote sensing super-resolution (SR) due to their excellent self-attention mechanisms. However, transformer models are prone to overfitting because of their large number of parameters, especially with the typically small remote sensing datasets. Additionally, the reliance of transformer-based SR models on convolution-based upsampling often leads to mismatched semantic information. To tackle these challenges, we propose an efficient super-resolution hybrid network (EHNet) based on the encoder composed of our designed lightweight convolution module and the decoder composed of an improved swin transformer. The encoder, featuring our novel Lightweight Feature Extraction Block (LFEB), employs a more efficient convolution method than depthwise separable convolution based on depthwise convolution. Our LFEB also integrates a Cross Stage Partial structure for enhanced feature extraction. In terms of the decoder, based on the swin transformer, we innovatively propose a sequence-based upsample block (SUB) for the first time, which directly uses the sequence of tokens in the transformer to focus on semantic information through the MLP layer, which enhances the feature expression ability of the model and improves the reconstruction accuracy. Experiments show that EHNet’s PSNR on UCMerced and AID datasets obtains a SOTA performance of 28.02 and 29.44, respectively, and is also visually better than other existing methods. Its 2.64 M parameters effectively balance model efficiency and computational demands.
Förderung
- Key Program Project of Science and Technology Innovation of the Chinese Academy of Sciences
- Innovation Foundation of Key Laboratory of Computational Optical Imaging Technology, CAS
Zitieren
APA
Zhang, W., Tan, Z., Lv, Q., Li, J., Zhu, B., & Liu, Y. (2024). An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution. Remote Sensing, 16(5), 880. https://doi.org/10.3390/rs16050880
Vancouver
Zhang W, Tan Z, Lv Q, Li J, Zhu B, Liu Y. An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution. Remote Sensing. 2024;16(5):880. doi:10.3390/rs16050880
BibTeX
@article{Zhang2024,
author = {Zhang, Wenjian and Tan, Zheng and Lv, Qunbo and Li, Jiaao and Zhu, Baoyu and Liu, Yangyang},
title = {An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {5},
pages = {880},
doi = {10.3390/rs16050880}
}
EUVIMED