An MoE-Driven Unified Image Restoration Framework for Adverse Weather Conditions
IEEE Transactions on Circuits and Systems for Video Technology · 2026-03 · 36 (3) · 3101-3116
DOI: 10.1109/tcsvt.2025.3625191 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-03. Verfasst von Tao An und 7 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 66 Literaturangaben. Gefördert von: Postdoctoral Fellowship Program of China Postdoctoral Science Foundation, Self-Planned Task of State Key Laboratory of Robotics and Systems Harbin Institute of Technology, Open Research Fund of Anhui Province Key Laboratory of Machine Vision Inspection.
Abstract (Originalsprache)
Adverse natural weather conditions frequently cause substantial performance degradation in outdoor vision systems, underscoring the critical importance of research on image restoration techniques. Employing a unified set of network parameters to restore degraded images across diverse weather conditions has emerged as a key research direction in the field of image restoration. In this work, we propose MUIRF, a Mixture-of-Experts (MoE)-driven unified image restoration framework for multiple adverse weather conditions. Specifically, our technical contribution includes a novel channel-level parameter sharing strategy guided by a shallow-feature-based MoE (CPSM). This fine-grained parameter sharing strategy adaptively selects convolution weight channels for cross-task sharing based on the input image, enabling the network to accurately capture weather-general features, while the remaining channels encode weather-specific features corresponding to each weather condition. CPSM facilitates precise channel selection, thereby enhancing the robustness and accuracy of MUIRF during joint training across diverse image restoration tasks under varying weather conditions. Additionally, gradient conflicts inevitably arise in shared parameters due to the divergent optimization objectives across tasks. To address this challenge, we propose a meta-vector-guided gradient homogenization (MVGH) algorithm that mitigates inter-task gradient conflicts and improves image restoration quality. Comprehensive experimental evaluations demonstrate that our proposed network outperforms most state-of-the-art approaches, validating its superior performance and effectiveness.
Förderung
- Postdoctoral Fellowship Program of China Postdoctoral Science Foundation
- Self-Planned Task of State Key Laboratory of Robotics and Systems Harbin Institute of Technology
- Open Research Fund of Anhui Province Key Laboratory of Machine Vision Inspection
- Technology Research and Development Project of “Call for Bids to Address Key Issues” of Heilongjiang Province
Zitieren
APA
An, T., Gao, H., Liu, R., Dai, K., Xie, T., Li, R., Wang, K., & Zhao, L. (2026). An MoE-Driven Unified Image Restoration Framework for Adverse Weather Conditions. IEEE Transactions on Circuits and Systems for Video Technology, 36(3), 3101-3116. https://doi.org/10.1109/tcsvt.2025.3625191
Vancouver
An T, Gao H, Liu R, Dai K, Xie T, Li R, et al. An MoE-Driven Unified Image Restoration Framework for Adverse Weather Conditions. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(3):3101-3116. doi:10.1109/tcsvt.2025.3625191
BibTeX
@article{An2026,
author = {An, Tao and Gao, Hongbo and Liu, Ruqi and Dai, Kun and Xie, Tao and Li, Ruifeng and Wang, Ke and Zhao, Lijun},
title = {An MoE-Driven Unified Image Restoration Framework for Adverse Weather Conditions},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2026},
volume = {36},
number = {3},
pages = {3101--3116},
doi = {10.1109/tcsvt.2025.3625191}
}
EUVIMED