Neural Face Skinning for Mesh‐agnostic Facial Expression Cloning
Computer Graphics Forum · 2025-05 · 44 (2)
DOI: 10.1111/cgf.70009 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 10.04.2025. Verfasst von Sihun Cha und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 51 Literaturangaben.
Abstract (Originalsprache)
Accurately retargeting facial expressions to a face mesh while enabling manipulation is a key challenge in facial animation retargeting. Recent deep‐learning methods address this by encoding facial expressions into a global latent code, but they often fail to capture fine‐grained details in local regions. While some methods improve local accuracy by transferring deformations locally, this often complicates overall control of the facial expression. To address this, we propose a method that combines the strengths of both global and local deformation models. Our approach enables intuitive control and detailed expression cloning across diverse face meshes, regardless of their underlying structures. The core idea is to localize the influence of the global latent code on the target mesh. Our model learns to predict skinning weights for each vertex of the target face mesh through indirect supervision from predefined segmentation labels. These predicted weights localize the global latent code, enabling precise and region‐specific deformations even for meshes with unseen shapes. We supervise the latent code using Facial Action Coding System (FACS)‐based blendshapes to ensure interpretability and allow straightforward editing of the generated animation. Through extensive experiments, we demonstrate improved performance over state‐of‐the‐art methods in terms of expression fidelity, deformation transfer accuracy, and adaptability across diverse mesh structures.
Zitieren
APA
Cha, S., Yoon, S., Seo, K., & Noh, J. (2025). Neural Face Skinning for Mesh‐agnostic Facial Expression Cloning. Computer Graphics Forum, 44(2). https://doi.org/10.1111/cgf.70009
Vancouver
Cha S, Yoon S, Seo K, Noh J. Neural Face Skinning for Mesh‐agnostic Facial Expression Cloning. Computer Graphics Forum. 2025;44(2). doi:10.1111/cgf.70009
BibTeX
@article{Cha2025,
author = {Cha, Sihun and Yoon, Serin and Seo, Kwanggyoon and Noh, Junyong},
title = {Neural Face Skinning for Mesh‐agnostic Facial Expression Cloning},
journal = {Computer Graphics Forum},
year = {2025},
volume = {44},
number = {2},
doi = {10.1111/cgf.70009}
}
EUVIMED