EUVIMEDEUVIMED entdecken
Crossref

All-in-One Transformer for Image Restoration Under Adverse Weather Degradations

Jiawei Mao, Yu Yang, Xuesong Yin, Ling Shao, Hao Tang

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-06 · 48 (6) · 6628-6641

DOI: 10.1109/tpami.2026.3658598 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-06. Verfasst von Jiawei Mao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 84 Literaturangaben. Gefördert von: Fundamental Research Funds for the Central Universities, Peking University, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Severe weather restoration models often face the simultaneous interaction of multiple degradations in real-world scenarios. Existing approaches typically handle single or composite degradations based on scene descriptors derived from text or image embeddings. However, due to the varying proportions of different degradations within an image, these scene descriptors may not accurately differentiate between degradations, leading to suboptimal restoration in practical applications. To address this issue, we propose a novel Transformer-based restoration framework, AllRestorer, for dealing with four physical severe weather impairments: low-light, haze, rain, and snow. In AllRestorer, we enable the model to adaptively consider all weather impairments, thereby avoiding errors from scene descriptor misdirection. Specifically, we introduce the All-in-One Transformer Block (AiOTB), the core innovation of which is the ability to adaptively handle multiple degradations in a single image, beyond the limitation of existing Transformers that can only handle one type of degradation at a time. To accurately address different variations potentially present within the same type of degradation and minimize ambiguity, AiOTB utilizes a Composite Scene Embedding consisting of both image and text embeddings to define the degradation. Moreover, AiOTB includes an adaptive weight for each degradation, allowing for precise control of the restoration intensity. By leveraging AiOTB, AllRestorer avoids misdirection caused by inaccurate scene descriptors, achieving a 5.00 dB increase in PSNR compared to the baseline on the CDD-11 dataset.

Förderung

  • Fundamental Research Funds for the Central Universities
  • Peking University
  • National Natural Science Foundation of China

Zitieren

APA

Mao, J., Yang, Y., Yin, X., Shao, L., & Tang, H. (2026). All-in-One Transformer for Image Restoration Under Adverse Weather Degradations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(6), 6628-6641. https://doi.org/10.1109/tpami.2026.3658598

Vancouver

Mao J, Yang Y, Yin X, Shao L, Tang H. All-in-One Transformer for Image Restoration Under Adverse Weather Degradations. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(6):6628-6641. doi:10.1109/tpami.2026.3658598

BibTeX
@article{Mao2026,
  author = {Mao, Jiawei and Yang, Yu and Yin, Xuesong and Shao, Ling and Tang, Hao},
  title = {All-in-One Transformer for Image Restoration Under Adverse Weather Degradations},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2026},
  volume = {48},
  number = {6},
  pages = {6628--6641},
  doi = {10.1109/tpami.2026.3658598}
}
Kostenlos starten →