Intra and Inter Parser-Prompted Transformers for Effective Image Restoration
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (7) · 7609-7618
DOI: 10.1609/aaai.v39i7.32819 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Cong Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref).
Abstract (Originalsprache)
We propose Intra and Inter Parser-Prompted Transformers (PPTformer) that explore useful features from visual foundation models for image restoration. Specifically, PPTformer contains two parts: an Image Restoration Network (IRNet) for restoring images from degraded observations and a Parser-Prompted Feature Generation Network (PPFGNet) for providing IRNet with reliable parser information to boost restoration. To enhance the integration of the parser within IRNet, we propose Intra Parser-Prompted Attention (IntraPPA) and Inter Parser-Prompted Attention (InterPPA) to implicitly and explicitly learn useful parser features to facilitate restoration. The IntraPPA re-considers cross attention between parser and restoration features, enabling implicit perception of the parser from a long-range and intra-layer perspective. Conversely, the InterPPA initially fuses restoration features with those of the parser, followed by formulating these fused features within an attention mechanism to explicitly perceive parser information. Further, we propose a parser-prompted feed-forward network to guide restoration within pixel-wise gating modulation. Experimental results show that PPTformer achieves state-of-the-art performance on image deraining, defocus deblurring, desnowing, and low-light enhancement.
Zitieren
APA
Wang, C., Pan, J., Wang, L., & Wang, W. (2025). Intra and Inter Parser-Prompted Transformers for Effective Image Restoration. Proceedings of the AAAI Conference on Artificial Intelligence, 39(7), 7609-7618. https://doi.org/10.1609/aaai.v39i7.32819
Vancouver
Wang C, Pan J, Wang L, Wang W. Intra and Inter Parser-Prompted Transformers for Effective Image Restoration. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(7):7609-7618. doi:10.1609/aaai.v39i7.32819
BibTeX
@article{Wang2025,
author = {Wang, Cong and Pan, Jinshan and Wang, Liyan and Wang, Wei},
title = {Intra and Inter Parser-Prompted Transformers for Effective Image Restoration},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {7},
pages = {7609--7618},
doi = {10.1609/aaai.v39i7.32819}
}
EUVIMED