High-Fidelity 3D Facial Avatar Synthesis With Controllable Fine-Grained Expressions
IEEE Transactions on Circuits and Systems for Video Technology · 2026-07 · 36 (7) · 9252-9264
DOI: 10.1109/tcsvt.2026.3674337 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-07. Verfasst von Yikang He und 4 weiteren Autor:innen. Die Arbeit nennt 87 Literaturangaben. Gefördert von: Fundamental Research Funds for the Central Universities, Natural Science Foundation of Beijing, China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Facial expression editing methods can be mainly categorized into two types based on their architectures: 2D-based and 3D-based methods. The former lacks 3D face modeling capabilities, making it difficult to edit 3D factors effectively. The latter has demonstrated superior performance in generating high-quality and view-consistent renderings using single-view 2D face images. Although these methods have successfully used animatable models to control facial expressions, they still have limitations in achieving precise control over fine-grained expressions. To address this issue, in this paper, we propose a novel approach by simultaneously refining both the latent code of a pretrained 3D-Aware GAN model for texture editing and the expression code of the driven 3DMM model for mesh editing. Specifically, we introduce a Dual Mappers module, comprising Texture Mapper and Emotion Mapper, to learn the transformations of the given latent code for textures and the expression code for meshes, respectively. To optimize the Dual Mappers, we propose a Text-Guided Optimization method, leveraging a CLIP-based objective function with expression text prompts as targets, while integrating a SubSpace Projection mechanism to project the text embedding to the expression subspace such that we can have more precise control over fine-grained expressions. Extensive experiments and comparative analyses demonstrate the effectiveness and superiority of our proposed method.
Förderung
- Fundamental Research Funds for the Central Universities
- Natural Science Foundation of Beijing, China
- National Natural Science Foundation of China
Zitieren
APA
He, Y., Zhang, J., Wang, W., Sebe, N., & Zhao, Y. (2026). High-Fidelity 3D Facial Avatar Synthesis With Controllable Fine-Grained Expressions. IEEE Transactions on Circuits and Systems for Video Technology, 36(7), 9252-9264. https://doi.org/10.1109/tcsvt.2026.3674337
Vancouver
He Y, Zhang J, Wang W, Sebe N, Zhao Y. High-Fidelity 3D Facial Avatar Synthesis With Controllable Fine-Grained Expressions. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(7):9252-9264. doi:10.1109/tcsvt.2026.3674337
BibTeX
@article{He2026,
author = {He, Yikang and Zhang, Jichao and Wang, Wei and Sebe, Nicu and Zhao, Yao},
title = {High-Fidelity 3D Facial Avatar Synthesis With Controllable Fine-Grained Expressions},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2026},
volume = {36},
number = {7},
pages = {9252--9264},
doi = {10.1109/tcsvt.2026.3674337}
}
EUVIMED