A Diffusion Model with A FFT for Image Inpainting
JOURNAL OF Cyber-Physical-Social Intelligence · 2022
DOI: 10.61702/mtpg8588 ↗Kurz gefasst
Fachartikel in der Zeitschrift JOURNAL OF Cyber-Physical-Social Intelligence, 2022. Verfasst von Yuxuan Hu und 4 weiteren Autor:innen.
Abstract (Originalsprache)
Diffusion models for image inpainting have been the subject of growing research interest in recent years. However, generating content that is consistent with the original images, especially for complex images with intricate details and structural information, remains a significant challenge. In this paper, we propose a diffusion model with an FFT (FFT-DM) to generate content that matches missing region texture and semantics to inpaint damaged images. Specifically, FFT-DM contains two components: a Denoising Diffusion Probabilistic Model (DDPM) and a Convolutional Neural Network (CNN). The DDPM is used to extract global features and generate image prior while the CNN captures more fine-grained details and predicts the parameters in the reverse process of the diffusion model. Notably, we integrate a Fast Fourier Transform (FFT) into the diffusion model to enhance the perception ability and improve the efficiency of the model. Extensive experiments demonstrate that FFT-DM outperforms current state-of-the-art inpainting approaches in terms of qualitative and quantitative analysis.
Zitieren
APA
Hu, Y., Wang, H., Jin, C., Li, B., & Tian, C. (2022). A Diffusion Model with A FFT for Image Inpainting. JOURNAL OF Cyber-Physical-Social Intelligence. https://doi.org/10.61702/mtpg8588
Vancouver
Hu Y, Wang H, Jin C, Li B, Tian C. A Diffusion Model with A FFT for Image Inpainting. JOURNAL OF Cyber-Physical-Social Intelligence. 2022. doi:10.61702/mtpg8588
BibTeX
@article{Hu2022,
author = {Hu, Yuxuan and Wang, Hanting and Jin, Cong and Li, Bo and Tian, Chunwei},
title = {A Diffusion Model with A FFT for Image Inpainting},
journal = {JOURNAL OF Cyber-Physical-Social Intelligence},
year = {2022},
doi = {10.61702/mtpg8588}
}
EUVIMED