EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Remote Sensing Image Dehazing via a Local Context-Enriched Transformer

Jing Nie, Jin Xie, Hanqing Sun

Remote Sensing · 17.04.2024 · 16 (8) · 1422

DOI: 10.3390/rs16081422 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 17.04.2024. Verfasst von Jing Nie und 2 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote sensing image dehazing is a well-known remote sensing image processing task focused on restoring clean images from hazy images. The Transformer network, based on the self-attention mechanism, has demonstrated remarkable advantages in various image restoration tasks, due to its capacity to capture long-range dependencies within images. However, it is weak at modeling local context. Conversely, convolutional neural networks (CNNs) are adept at capturing local contextual information. Local contextual information could provide more details, while long-range dependencies capture global structure information. The combination of long-range dependencies and local context modeling is beneficial for remote sensing image dehazing. Therefore, in this paper, we propose a CNN-based adaptive local context enrichment module (ALCEM) to extract contextual information within local regions. Subsequently, we integrate our proposed ALCEM into the multi-head self-attention and feed-forward network of the Transformer, constructing a novel locally enhanced attention (LEA) and a local continuous-enhancement feed-forward network (LCFN). The LEA utilizes the ALCEM to inject local context information that is complementary to the long-range relationship modeled by multi-head self-attention, which is beneficial to removing haze and restoring details. The LCFN extracts multi-scale spatial information and selectively fuses them by the the ALCEM, which supplements more informative information compared with existing regular feed-forward networks with only position-specific information flow. Powered by the LEA and LCFN, a novel Transformer-based dehazing network termed LCEFormer is proposed to restore clear images from hazy remote sensing images, which combines the advantages of CNN and Transformer. Experiments conducted on three distinct datasets, namely DHID, ERICE, and RSID, demonstrate that our proposed LCEFormer achieves the state-of-the-art performance in hazy scenes. Specifically, our LCEFormer outperforms DCIL by 0.78 dB and 0.018 for PSNR and SSIM on the DHID dataset.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Nie, J., Xie, J., & Sun, H. (2024). Remote Sensing Image Dehazing via a Local Context-Enriched Transformer. Remote Sensing, 16(8), 1422. https://doi.org/10.3390/rs16081422

Vancouver

Nie J, Xie J, Sun H. Remote Sensing Image Dehazing via a Local Context-Enriched Transformer. Remote Sensing. 2024;16(8):1422. doi:10.3390/rs16081422

BibTeX
@article{Nie2024,
  author = {Nie, Jing and Xie, Jin and Sun, Hanqing},
  title = {Remote Sensing Image Dehazing via a Local Context-Enriched Transformer},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {8},
  pages = {1422},
  doi = {10.3390/rs16081422}
}
Kostenlos starten →