EUVIMEDEUVIMED entdecken
Crossref

FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment

Yuval Nirkin, Yosi Keller, Tal Hassner

IEEE Transactions on Pattern Analysis and Machine Intelligence · 01.01.2023 · 45 (1) · 560-575

DOI: 10.1109/tpami.2022.3155571 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, erschienen am 01.01.2023. Verfasst von Yuval Nirkin und 2 weiteren Autor:innen. Die Arbeit wurde bisher 67-mal zitiert (Crossref) und nennt 74 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present Face Swapping GAN (FSGAN) for face swapping and reenactment. Unlike previous work, we offer a subject agnostic swapping scheme that can be applied to pairs of faces without requiring training on those faces. We derive a novel iterative deep learning-based approach for face reenactment which adjusts significant pose and expression variations that can be applied to a single image or a video sequence. For video sequences, we introduce a continuous interpolation of the face views based on reenactment, Delaunay Triangulation, and barycentric coordinates. Occluded face regions are handled by a face completion network. Finally, we use a face blending network for seamless blending of the two faces while preserving the target skin color and lighting conditions. This network uses a novel Poisson blending loss combining Poisson optimization with a perceptual loss. We compare our approach to existing state-of-the-art systems and show our results to be both qualitatively and quantitatively superior. This work describes extensions of the FSGAN method, proposed in an earlier conference version of our work (Nirkin et al. 2019), as well as additional experiments and results.

Zitieren

APA

Nirkin, Y., Keller, Y., & Hassner, T. (2023). FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1), 560-575. https://doi.org/10.1109/tpami.2022.3155571

Vancouver

Nirkin Y, Keller Y, Hassner T. FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(1):560-575. doi:10.1109/tpami.2022.3155571

BibTeX
@article{Nirkin2023,
  author = {Nirkin, Yuval and Keller, Yosi and Hassner, Tal},
  title = {FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2023},
  volume = {45},
  number = {1},
  pages = {560--575},
  doi = {10.1109/tpami.2022.3155571}
}
Kostenlos starten →