Image Restoration via Frequency Selection
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-02 · 46 (2) · 1093-1108
DOI: 10.1109/tpami.2023.3330416 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-02. Verfasst von Yuning Cui und 3 weiteren Autor:innen. Die Arbeit wurde bisher 275-mal zitiert (Crossref) und nennt 108 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shenzhen Science and Technology Program.
Abstract (Originalsprache)
Image restoration aims to reconstruct the latent sharp image from its corrupted counterpart. Besides dealing with this long-standing task in the spatial domain, a few approaches seek solutions in the frequency domain by considering the large discrepancy between spectra of sharp/degraded image pairs. However, these algorithms commonly utilize transformation tools, e.g., wavelet transform, to split features into several frequency parts, which is not flexible enough to select the most informative frequency component to recover. In this paper, we exploit a multi-branch and content-aware module to decompose features into separate frequency subbands dynamically and locally, and then accentuate the useful ones via channel-wise attention weights. In addition, to handle large-scale degradation blurs, we propose an extremely simple decoupling and modulation module to enlarge the receptive field via global and window-based average pooling. Furthermore, we merge the paradigm of multi-stage networks into a single U-shaped network to pursue multi-scale receptive fields and improve efficiency. Finally, integrating the above designs into a convolutional backbone, the proposed Frequency Selection Network (FSNet) performs favorably against state-of-the-art algorithms on 20 different benchmark datasets for 6 representative image restoration tasks, including single-image defocus deblurring, image dehazing, image motion deblurring, image desnowing, image deraining, and image denoising.
Förderung
- National Natural Science Foundation of China
- Shenzhen Science and Technology Program
Zitieren
APA
Cui, Y., Ren, W., Cao, X., & Knoll, A. (2024). Image Restoration via Frequency Selection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(2), 1093-1108. https://doi.org/10.1109/tpami.2023.3330416
Vancouver
Cui Y, Ren W, Cao X, Knoll A. Image Restoration via Frequency Selection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(2):1093-1108. doi:10.1109/tpami.2023.3330416
BibTeX
@article{Cui2024,
author = {Cui, Yuning and Ren, Wenqi and Cao, Xiaochun and Knoll, Alois},
title = {Image Restoration via Frequency Selection},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {2},
pages = {1093--1108},
doi = {10.1109/tpami.2023.3330416}
}
EUVIMED