EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FaceIt: Real‐Time On‐Device Identity‐Preserving Portrait Animation

M. Dvorožňák, D. Sýkora, C. Curtis, B. Curless, Y. Xu, Z. Zhou, O. Sorkine‐Hornung, D. Salesin

Computer Graphics Forum · 01.07.2026

DOI: 10.1111/cgf.70509 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 01.07.2026. Verfasst von M. Dvorožňák und 7 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Center for Informatics, Czech Technical University in Prague.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recently, significant progress has been made in generating expressive and temporally coherent portrait animations. Given a single portrait image, methods such as LivePortrait [GZL*24], Follow‐Your‐Emoji [MLW*24] or proprietary Act‐One [Run25] can animate it using motion extracted from a driving video. The resulting animation supports a wide range of head movements while being able to preserve many aspects of facial expressions. Despite these methods' impressive results, there are obstacles to their use in scenarios where computational budget is limited (e.g., on mobile devices) or when the aim is to retain the identity of the person in the driving video. In this paper, we present a novel approach to identity‐preserving animation of a given portrait image that can run in real time even on a mobile device, inject the user' s identity, and reproduce detailed facial expressions. Our key contribution is an algorithmic solution that retains the appearance of the given portrait image while transferring coarse motions as well as detailed facial expressions of the user who drives the animation. The method runs in real time on a mobile GPU, achieving visual quality that sometimes outperforms even approaches that have notably higher computational overhead.

Förderung

  • Research Center for Informatics, Czech Technical University in Prague

Zitieren

APA

Dvorožňák, M., Sýkora, D., Curtis, C., Curless, B., Xu, Y., Zhou, Z., Sorkine‐Hornung, O., & Salesin, D. (2026). FaceIt: Real‐Time On‐Device Identity‐Preserving Portrait Animation. Computer Graphics Forum. https://doi.org/10.1111/cgf.70509

Vancouver

Dvorožňák M, Sýkora D, Curtis C, Curless B, Xu Y, Zhou Z, et al. FaceIt: Real‐Time On‐Device Identity‐Preserving Portrait Animation. Computer Graphics Forum. 2026. doi:10.1111/cgf.70509

BibTeX
@article{Dvorok2026,
  author = {Dvorožňák, M. and Sýkora, D. and Curtis, C. and Curless, B. and Xu, Y. and Zhou, Z. and Sorkine‐Hornung, O. and Salesin, D.},
  title = {FaceIt: Real‐Time On‐Device Identity‐Preserving Portrait Animation},
  journal = {Computer Graphics Forum},
  year = {2026},
  doi = {10.1111/cgf.70509}
}
Kostenlos starten →