EUVIMEDEUVIMED entdecken
Crossref

AvatarReX: Real-time Expressive Full-body Avatars

Zerong Zheng, Xiaochen Zhao, Hongwen Zhang, Boning Liu, Yebin Liu

ACM Transactions on Graphics · 2023-08 · 42 (4) · 1-19

DOI: 10.1145/3592101 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 26.07.2023. Verfasst von Zerong Zheng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 90-mal zitiert (Crossref) und nennt 104 Literaturangaben. Gefördert von: National Key R&D Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present AvatarReX, a new method for learning NeRF-based full-body avatars from video data. The learnt avatar not only provides expressive control of the body, hands and the face together, but also supports real-time animation and rendering. To this end, we propose a compositional avatar representation, where the body, hands and the face are separately modeled in a way that the structural prior from parametric mesh templates is properly utilized without compromising representation flexibility. Furthermore, we disentangle the geometry and appearance for each part. With these technical designs, we propose a dedicated deferred rendering pipeline, which can be executed at a real-time framerate to synthesize high-quality free-view images. The disentanglement of geometry and appearance also allows us to design a two-pass training strategy that combines volume rendering and surface rendering for network training. In this way, patch-level supervision can be applied to force the network to learn sharp appearance details on the basis of geometry estimation. Overall, our method enables automatic construction of expressive full-body avatars with real-time rendering capability, and can generate photo-realistic images with dynamic details for novel body motions and facial expressions.

Förderung

  • National Key R&D Program of China

Zitieren

APA

Zheng, Z., Zhao, X., Zhang, H., Liu, B., & Liu, Y. (2023). AvatarReX: Real-time Expressive Full-body Avatars. ACM Transactions on Graphics, 42(4), 1-19. https://doi.org/10.1145/3592101

Vancouver

Zheng Z, Zhao X, Zhang H, Liu B, Liu Y. AvatarReX: Real-time Expressive Full-body Avatars. ACM Transactions on Graphics. 2023;42(4):1-19. doi:10.1145/3592101

BibTeX
@article{Zheng2023,
  author = {Zheng, Zerong and Zhao, Xiaochen and Zhang, Hongwen and Liu, Boning and Liu, Yebin},
  title = {AvatarReX: Real-time Expressive Full-body Avatars},
  journal = {ACM Transactions on Graphics},
  year = {2023},
  volume = {42},
  number = {4},
  pages = {1--19},
  doi = {10.1145/3592101}
}
Kostenlos starten →