EUVIMEDEUVIMED entdecken
Crossref

High-Fidelity 3D Facial Avatar Synthesis With Controllable Fine-Grained Expressions

Yikang He, Jichao Zhang, Wei Wang, Nicu Sebe, Yao Zhao

IEEE Transactions on Circuits and Systems for Video Technology · 2026-07 · 36 (7) · 9252-9264

DOI: 10.1109/tcsvt.2026.3674337 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-07. Verfasst von Yikang He und 4 weiteren Autor:innen. Die Arbeit nennt 87 Literaturangaben. Gefördert von: Fundamental Research Funds for the Central Universities, Natural Science Foundation of Beijing, China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression editing methods can be mainly categorized into two types based on their architectures: 2D-based and 3D-based methods. The former lacks 3D face modeling capabilities, making it difficult to edit 3D factors effectively. The latter has demonstrated superior performance in generating high-quality and view-consistent renderings using single-view 2D face images. Although these methods have successfully used animatable models to control facial expressions, they still have limitations in achieving precise control over fine-grained expressions. To address this issue, in this paper, we propose a novel approach by simultaneously refining both the latent code of a pretrained 3D-Aware GAN model for texture editing and the expression code of the driven 3DMM model for mesh editing. Specifically, we introduce a Dual Mappers module, comprising Texture Mapper and Emotion Mapper, to learn the transformations of the given latent code for textures and the expression code for meshes, respectively. To optimize the Dual Mappers, we propose a Text-Guided Optimization method, leveraging a CLIP-based objective function with expression text prompts as targets, while integrating a SubSpace Projection mechanism to project the text embedding to the expression subspace such that we can have more precise control over fine-grained expressions. Extensive experiments and comparative analyses demonstrate the effectiveness and superiority of our proposed method.

Förderung

  • Fundamental Research Funds for the Central Universities
  • Natural Science Foundation of Beijing, China
  • National Natural Science Foundation of China

Zitieren

APA

He, Y., Zhang, J., Wang, W., Sebe, N., & Zhao, Y. (2026). High-Fidelity 3D Facial Avatar Synthesis With Controllable Fine-Grained Expressions. IEEE Transactions on Circuits and Systems for Video Technology, 36(7), 9252-9264. https://doi.org/10.1109/tcsvt.2026.3674337

Vancouver

He Y, Zhang J, Wang W, Sebe N, Zhao Y. High-Fidelity 3D Facial Avatar Synthesis With Controllable Fine-Grained Expressions. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(7):9252-9264. doi:10.1109/tcsvt.2026.3674337

BibTeX
@article{He2026,
  author = {He, Yikang and Zhang, Jichao and Wang, Wei and Sebe, Nicu and Zhao, Yao},
  title = {High-Fidelity 3D Facial Avatar Synthesis With Controllable Fine-Grained Expressions},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2026},
  volume = {36},
  number = {7},
  pages = {9252--9264},
  doi = {10.1109/tcsvt.2026.3674337}
}
Kostenlos starten →