Image Desnowing via Deep Invertible Separation
IEEE Transactions on Circuits and Systems for Video Technology · 2023-07 · 33 (7) · 3133-3144
DOI: 10.1109/tcsvt.2022.3233655 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2023-07. Verfasst von Yuhui Quan und 4 weiteren Autor:innen. Die Arbeit wurde bisher 50-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Guangdong Province, Singapore MOE AcRF.
Abstract (Originalsprache)
Images taken on snowy days often suffer from severe negative visual effects caused by snowflakes. The task of removing snowflakes from a snowy image is known as image desnowing, which is challenging as image details are easily mistakenly treated and thus may be significantly lost during snowflake removal. Leveraging invertible neural networks (INNs), this paper presents a deep learning-based method for single image desnowing, which can remove snowflakes accurately while preserving image details well. Interpreting desnowing as an image decomposition problem, we propose an INN composed of two asymmetric interactive paths for predicting a latent image and a snowflake layer respectively. Such an INN is able to progressively refine the features of both latent images and snowflake layers for disentanglement, while retaining all information possibly relevant to latent image reconstruction. In addition, an attentive coupling layer supervised by snowflake masks is introduced to enhance feature dismantlement and a coupling-in-coupling structure is developed for further improvement. Extensive experiments show that, the proposed method outperforms existing ones on three benchmark datasets of synthetic and real-world images, and meanwhile it also shows advantages in terms of model size and computational efficiency.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Guangdong Province
- Singapore MOE AcRF
Zitieren
APA
Quan, Y., Tan, X., Huang, Y., Xu, Y., & Ji, H. (2023). Image Desnowing via Deep Invertible Separation. IEEE Transactions on Circuits and Systems for Video Technology, 33(7), 3133-3144. https://doi.org/10.1109/tcsvt.2022.3233655
Vancouver
Quan Y, Tan X, Huang Y, Xu Y, Ji H. Image Desnowing via Deep Invertible Separation. IEEE Transactions on Circuits and Systems for Video Technology. 2023;33(7):3133-3144. doi:10.1109/tcsvt.2022.3233655
BibTeX
@article{Quan2023,
author = {Quan, Yuhui and Tan, Xiaoheng and Huang, Yan and Xu, Yong and Ji, Hui},
title = {Image Desnowing via Deep Invertible Separation},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2023},
volume = {33},
number = {7},
pages = {3133--3144},
doi = {10.1109/tcsvt.2022.3233655}
}
EUVIMED