EUVIMEDEUVIMED entdecken
Crossref

A Diffusion Model with A FFT for Image Inpainting

Yuxuan Hu, Hanting Wang, Cong Jin, Bo Li, Chunwei Tian

JOURNAL OF Cyber-Physical-Social Intelligence · 2022

DOI: 10.61702/mtpg8588 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JOURNAL OF Cyber-Physical-Social Intelligence, 2022. Verfasst von Yuxuan Hu und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Diffusion models for image inpainting have been the subject of growing research interest in recent years. However, generating content that is consistent with the original images, especially for complex images with intricate details and structural information, remains a significant challenge. In this paper, we propose a diffusion model with an FFT (FFT-DM) to generate content that matches missing region texture and semantics to inpaint damaged images. Specifically, FFT-DM contains two components: a Denoising Diffusion Probabilistic Model (DDPM) and a Convolutional Neural Network (CNN). The DDPM is used to extract global features and generate image prior while the CNN captures more fine-grained details and predicts the parameters in the reverse process of the diffusion model. Notably, we integrate a Fast Fourier Transform (FFT) into the diffusion model to enhance the perception ability and improve the efficiency of the model. Extensive experiments demonstrate that FFT-DM outperforms current state-of-the-art inpainting approaches in terms of qualitative and quantitative analysis.

Zitieren

APA

Hu, Y., Wang, H., Jin, C., Li, B., & Tian, C. (2022). A Diffusion Model with A FFT for Image Inpainting. JOURNAL OF Cyber-Physical-Social Intelligence. https://doi.org/10.61702/mtpg8588

Vancouver

Hu Y, Wang H, Jin C, Li B, Tian C. A Diffusion Model with A FFT for Image Inpainting. JOURNAL OF Cyber-Physical-Social Intelligence. 2022. doi:10.61702/mtpg8588

BibTeX
@article{Hu2022,
  author = {Hu, Yuxuan and Wang, Hanting and Jin, Cong and Li, Bo and Tian, Chunwei},
  title = {A Diffusion Model with A FFT for Image Inpainting},
  journal = {JOURNAL OF Cyber-Physical-Social Intelligence},
  year = {2022},
  doi = {10.61702/mtpg8588}
}
Kostenlos starten →