EUVIMEDEUVIMED entdecken
Crossref

Reference-Guided Large-Scale Face Inpainting With Identity and Texture Control

Wuyang Luo, Su Yang, Weishan Zhang

IEEE Transactions on Circuits and Systems for Video Technology · 2023-10 · 33 (10) · 5498-5509

DOI: 10.1109/tcsvt.2023.3257271 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2023-10. Verfasst von Wuyang Luo und 2 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 79 Literaturangaben. Gefördert von: State Grid Corporation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Face inpainting aims at plausibly predicting missing pixels of face images within a corrupted region. Most existing methods rely on generative models learning a face image distribution from a big dataset, which produces uncontrollable results, especially with large-scale missing regions. To introduce strong control for face inpainting, we propose a novel reference-guided face inpainting method that fills the large-scale missing region with identity and texture control guided by a reference face image. However, generating high-quality results under imposing two control signals is challenging. To tackle such difficulty, we propose a dual control one-stage framework that decouples the reference image into two levels for flexible control: High-level identity information and low-level texture information, where the identity information figures out the shape of the face and the texture information depicts the component-aware texture. To synthesize high-quality results, we design two novel modules referred to as Half-AdaIN and Component-Wise Style Injector (CWSI) to inject the two kinds of control information into the inpainting processing. Our method produces realistic results with identity and texture control faithful to reference images. To the best of our knowledge, it is the first work to concurrently apply identity and component-level controls in face inpainting to promise more precise and controllable results.

Förderung

  • State Grid Corporation of China

Zitieren

APA

Luo, W., Yang, S., & Zhang, W. (2023). Reference-Guided Large-Scale Face Inpainting With Identity and Texture Control. IEEE Transactions on Circuits and Systems for Video Technology, 33(10), 5498-5509. https://doi.org/10.1109/tcsvt.2023.3257271

Vancouver

Luo W, Yang S, Zhang W. Reference-Guided Large-Scale Face Inpainting With Identity and Texture Control. IEEE Transactions on Circuits and Systems for Video Technology. 2023;33(10):5498-5509. doi:10.1109/tcsvt.2023.3257271

BibTeX
@article{Luo2023,
  author = {Luo, Wuyang and Yang, Su and Zhang, Weishan},
  title = {Reference-Guided Large-Scale Face Inpainting With Identity and Texture Control},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2023},
  volume = {33},
  number = {10},
  pages = {5498--5509},
  doi = {10.1109/tcsvt.2023.3257271}
}
Kostenlos starten →