EUVIMEDOpdag EUVIMED
Crossref

A Diffusion Model with A FFT for Image Inpainting

Yuxuan Hu, Hanting Wang, Cong Jin, Bo Li, Chunwei Tian

JOURNAL OF Cyber-Physical-Social Intelligence · 2022

DOI: 10.61702/mtpg8588 ↗

At a glance

Journal article in JOURNAL OF Cyber-Physical-Social Intelligence, 2022. Written by Yuxuan Hu and 4 co-authors.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Diffusion models for image inpainting have been the subject of growing research interest in recent years. However, generating content that is consistent with the original images, especially for complex images with intricate details and structural information, remains a significant challenge. In this paper, we propose a diffusion model with an FFT (FFT-DM) to generate content that matches missing region texture and semantics to inpaint damaged images. Specifically, FFT-DM contains two components: a Denoising Diffusion Probabilistic Model (DDPM) and a Convolutional Neural Network (CNN). The DDPM is used to extract global features and generate image prior while the CNN captures more fine-grained details and predicts the parameters in the reverse process of the diffusion model. Notably, we integrate a Fast Fourier Transform (FFT) into the diffusion model to enhance the perception ability and improve the efficiency of the model. Extensive experiments demonstrate that FFT-DM outperforms current state-of-the-art inpainting approaches in terms of qualitative and quantitative analysis.

Cite

APA

Hu, Y., Wang, H., Jin, C., Li, B., & Tian, C. (2022). A Diffusion Model with A FFT for Image Inpainting. JOURNAL OF Cyber-Physical-Social Intelligence. https://doi.org/10.61702/mtpg8588

Vancouver

Hu Y, Wang H, Jin C, Li B, Tian C. A Diffusion Model with A FFT for Image Inpainting. JOURNAL OF Cyber-Physical-Social Intelligence. 2022. doi:10.61702/mtpg8588

BibTeX
@article{Hu2022,
  author = {Hu, Yuxuan and Wang, Hanting and Jin, Cong and Li, Bo and Tian, Chunwei},
  title = {A Diffusion Model with A FFT for Image Inpainting},
  journal = {JOURNAL OF Cyber-Physical-Social Intelligence},
  year = {2022},
  doi = {10.61702/mtpg8588}
}
Start for free →