HAT: Hybrid Attention Transformer for Image Restoration
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-03 · 48 (3) · 2676-2694
DOI: 10.1109/tpami.2025.3628275 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-03. Verfasst von Xiangyu Chen und 6 weiteren Autor:innen. Die Arbeit wurde bisher 61-mal zitiert (Crossref) und nennt 107 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Macau Science and Technology Development Fund, Research Committee at University of Macau.
Abstract (Originalsprache)
Transformer-based methods have shown impressive performance in image restoration tasks, such as image super-resolution and denoising. However, we find that these networks can only utilize a limited spatial range of input information through attribution analysis. This implies that the potential of Transformer is still not fully exploited in existing networks. In order to activate more input pixels for better restoration, we propose a new Hybrid Attention Transformer (HAT). It combines both channel attention and window-based self-attention schemes, thus making use of their complementary advantages. Moreover, to better aggregate the cross-window information, we introduce an overlapping cross-attention module to enhance the interaction between neighboring window features. In the training stage, we additionally adopt a same-task pre-training strategy to further exploit the potential of the model for further improvement. Extensive experiments have demonstrated the effectiveness of the proposed modules. We further scale up the model to show that the performance of the SR task can be greatly improved. Besides, we extend HAT to more image restoration applications, including real-world image super-resolution, Gaussian image denoising and image compression artifacts reduction. Experiments on benchmark and real-world datasets demonstrate that our HAT achieves state-of-the-art performance both quantitatively and qualitatively.
Förderung
- National Natural Science Foundation of China
- Macau Science and Technology Development Fund
- Research Committee at University of Macau
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Chen, X., Wang, X., Zhang, W., Kong, X., Qiao, Y., Zhou, J., & Dong, C. (2026). HAT: Hybrid Attention Transformer for Image Restoration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(3), 2676-2694. https://doi.org/10.1109/tpami.2025.3628275
Vancouver
Chen X, Wang X, Zhang W, Kong X, Qiao Y, Zhou J, et al. HAT: Hybrid Attention Transformer for Image Restoration. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(3):2676-2694. doi:10.1109/tpami.2025.3628275
BibTeX
@article{Chen2026,
author = {Chen, Xiangyu and Wang, Xintao and Zhang, Wenlong and Kong, Xiangtao and Qiao, Yu and Zhou, Jiantao and Dong, Chao},
title = {HAT: Hybrid Attention Transformer for Image Restoration},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2026},
volume = {48},
number = {3},
pages = {2676--2694},
doi = {10.1109/tpami.2025.3628275}
}
EUVIMED