Diffusion Models in Low-Level Vision: A Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-06 · 47 (6) · 4630-4651
DOI: 10.1109/tpami.2025.3545047 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-06. Verfasst von Chunming He und 8 weiteren Autor:innen. Die Arbeit wurde bisher 104-mal zitiert (Crossref) und nennt 216 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: STI 2030-Major Projects.
Abstract (Originalsprache)
Deep generative models have gained considerable attention in low-level vision tasks due to their powerful generative capabilities. Among these, diffusion model-based approaches, which employ a forward diffusion process to degrade an image and a reverse denoising process for image generation, have become particularly prominent for producing high-quality, diverse samples with intricate texture details. Despite their widespread success in low-level vision, there remains a lack of a comprehensive, insightful survey that synthesizes and organizes the advances in diffusion model-based techniques. To address this gap, this paper presents the first comprehensive review focused on denoising diffusion models applied to low-level vision tasks, covering both theoretical and practical contributions. We outline three general diffusion modeling frameworks and explore their connections with other popular deep generative models, establishing a solid theoretical foundation for subsequent analysis. We then categorize diffusion models used in low-level vision tasks from multiple perspectives, considering both the underlying framework and the target application. Beyond natural image processing, we also summarize diffusion models applied to other low-level vision domains, including medical imaging, remote sensing, and video processing. Additionally, we provide an overview of widely used benchmarks and evaluation metrics in low-level vision tasks. Our review includes an extensive evaluation of diffusion model-based techniques across six representative tasks, with both quantitative and qualitative analysis. Finally, we highlight the limitations of current diffusion models and propose four promising directions for future research. This comprehensive review aims to foster a deeper understanding of the role of denoising diffusion models in low-level vision.
Förderung
- STI 2030-Major Projects
Zitieren
APA
He, C., Shen, Y., Fang, C., Xiao, F., Tang, L., Zhang, Y., Zuo, W., Guo, Z., & Li, X. (2025). Diffusion Models in Low-Level Vision: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(6), 4630-4651. https://doi.org/10.1109/tpami.2025.3545047
Vancouver
He C, Shen Y, Fang C, Xiao F, Tang L, Zhang Y, et al. Diffusion Models in Low-Level Vision: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(6):4630-4651. doi:10.1109/tpami.2025.3545047
BibTeX
@article{He2025,
author = {He, Chunming and Shen, Yuqi and Fang, Chengyu and Xiao, Fengyang and Tang, Longxiang and Zhang, Yulun and Zuo, Wangmeng and Guo, Zhenhua and Li, Xiu},
title = {Diffusion Models in Low-Level Vision: A Survey},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {6},
pages = {4630--4651},
doi = {10.1109/tpami.2025.3545047}
}
EUVIMED