EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-Attention Multi-Image Super-Resolution Transformer (MAST) for Remote Sensing

Jiaao Li, Qunbo Lv, Wenjian Zhang, Baoyu Zhu, Guiyu Zhang, Zheng Tan

Remote Sensing · 25.08.2023 · 15 (17) · 4183

DOI: 10.3390/rs15174183 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 25.08.2023. Verfasst von Jiaao Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Program Project of Science and Technology Innovation of the Chinese Academy of Sciences, Innovation Foundation of the Key Laboratory of Computational Optical Imaging Technology, CAS.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep-learning-driven multi-image super-resolution (MISR) reconstruction techniques have significant application value in the field of aerospace remote sensing. In particular, Transformer-based models have shown outstanding performance in super-resolution tasks. However, current MISR models have some deficiencies in the application of multi-scale information and the modeling of the attention mechanism, leading to an insufficient utilization of complementary information in multiple images. In this context, we innovatively propose a Multi-Attention Multi-Image Super-Resolution Transformer (MAST), which involves improvements in two main aspects. Firstly, we present a Multi-Scale and Mixed Attention Block (MMAB). With its multi-scale structure, the network is able to extract image features from different scales to obtain more contextual information. Additionally, the introduction of mixed attention allows the network to fully explore high-frequency features of the images in both channel and spatial dimensions. Secondly, we propose a Collaborative Attention Fusion Block (CAFB). By incorporating channel attention into the self-attention layer of the Transformer, we aim to better establish global correlations between multiple images. To improve the network’s perception ability of local detailed features, we introduce a Residual Local Attention Block (RLAB). With the aforementioned improvements, our model can better extract and utilize non-redundant information, achieving a superior restoration effect that balances the global structure and local details of the image. The results from the comparative experiments reveal that our approach demonstrated a notable enhancement in cPSNR, with improvements of 0.91 dB and 0.81 dB observed in the NIR and RED bands of the PROBA-V dataset, respectively, in comparison to the existing state-of-the-art methods. Extensive experiments demonstrate that the method proposed in this paper can provide a valuable reference for solving multi-image super-resolution tasks for remote sensing.

Förderung

  • Key Program Project of Science and Technology Innovation of the Chinese Academy of Sciences
  • Innovation Foundation of the Key Laboratory of Computational Optical Imaging Technology, CAS

Zitieren

APA

Li, J., Lv, Q., Zhang, W., Zhu, B., Zhang, G., & Tan, Z. (2023). Multi-Attention Multi-Image Super-Resolution Transformer (MAST) for Remote Sensing. Remote Sensing, 15(17), 4183. https://doi.org/10.3390/rs15174183

Vancouver

Li J, Lv Q, Zhang W, Zhu B, Zhang G, Tan Z. Multi-Attention Multi-Image Super-Resolution Transformer (MAST) for Remote Sensing. Remote Sensing. 2023;15(17):4183. doi:10.3390/rs15174183

BibTeX
@article{Li2023,
  author = {Li, Jiaao and Lv, Qunbo and Zhang, Wenjian and Zhu, Baoyu and Zhang, Guiyu and Tan, Zheng},
  title = {Multi-Attention Multi-Image Super-Resolution Transformer (MAST) for Remote Sensing},
  journal = {Remote Sensing},
  year = {2023},
  volume = {15},
  number = {17},
  pages = {4183},
  doi = {10.3390/rs15174183}
}
Kostenlos starten →