EUVIMEDEUVIMED entdecken
Crossref

From Coarse to Fine: Hierarchical Pixel Integration for Lightweight Image Super-resolution

Jie Liu, Chao Chen, Jie Tang, Gangshan Wu

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (2) · 1666-1674

DOI: 10.1609/aaai.v37i2.25254 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Jie Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Image super-resolution (SR) serves as a fundamental tool for the processing and transmission of multimedia data. Recently, Transformer-based models have achieved competitive performances in image SR. They divide images into fixed-size patches and apply self-attention on these patches to model long-range dependencies among pixels. However, this architecture design is originated for high-level vision tasks, which lacks design guideline from SR knowledge. In this paper, we aim to design a new attention block whose insights are from the interpretation of Local Attribution Map (LAM) for SR networks. Specifically, LAM presents a hierarchical importance map where the most important pixels are located in a fine area of a patch and some less important pixels are spread in a coarse area of the whole image. To access pixels in the coarse area, instead of using a very large patch size, we propose a lightweight Global Pixel Access (GPA) module that applies cross-attention with the most similar patch in an image. In the fine area, we use an Intra-Patch Self-Attention (IPSA) module to model long-range pixel dependencies in a local patch, and then a spatial convolution is applied to process the finest details. In addition, a Cascaded Patch Division (CPD) strategy is proposed to enhance perceptual quality of recovered images. Extensive experiments suggest that our method outperforms state-of-the-art lightweight SR methods by a large margin. Code is available at https://github.com/passerer/HPINet.

Zitieren

APA

Liu, J., Chen, C., Tang, J., & Wu, G. (2023). From Coarse to Fine: Hierarchical Pixel Integration for Lightweight Image Super-resolution. Proceedings of the AAAI Conference on Artificial Intelligence, 37(2), 1666-1674. https://doi.org/10.1609/aaai.v37i2.25254

Vancouver

Liu J, Chen C, Tang J, Wu G. From Coarse to Fine: Hierarchical Pixel Integration for Lightweight Image Super-resolution. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(2):1666-1674. doi:10.1609/aaai.v37i2.25254

BibTeX
@article{Liu2023,
  author = {Liu, Jie and Chen, Chao and Tang, Jie and Wu, Gangshan},
  title = {From Coarse to Fine: Hierarchical Pixel Integration for Lightweight Image Super-resolution},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {2},
  pages = {1666--1674},
  doi = {10.1609/aaai.v37i2.25254}
}
Kostenlos starten →