EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

HDHumans

Marc Habermann, Lingjie Liu, Weipeng Xu, Gerard Pons-Moll, Michael Zollhoefer, Christian Theobalt

Proceedings of the ACM on Computer Graphics and Interactive Techniques · 16.08.2023 · 6 (3) · 1-23

DOI: 10.1145/3606927 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Computer Graphics and Interactive Techniques, online erschienen am 24.08.2023. Verfasst von Marc Habermann und 5 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitieren

Abstract (Originalsprache)

Photo-real digital human avatars are of enormous importance in graphics, as they enable immersive communication over the globe, improve gaming and entertainment experiences, and can be particularly beneficial for AR and VR settings. However, current avatar generation approaches either fall short in high-fidelity novel view synthesis, generalization to novel motions, reproduction of loose clothing, or they cannot render characters at the high resolution offered by modern displays. To this end, we propose HDHumans, which is the first method for HD human character synthesis that jointly produces an accurate and temporally coherent 3D deforming surface and highly photo-realistic images of arbitrary novel views and of motions not seen at training time. At the technical core, our method tightly integrates a classical deforming character template with neural radiance fields (NeRF). Our method is carefully designed to achieve a synergy between classical surface deformation and a NeRF. First, the template guides the NeRF, which allows synthesizing novel views of a highly dynamic and articulated character and even enables the synthesis of novel motions. Second, we also leverage the dense pointclouds resulting from the NeRF to further improve the deforming surface via 3D-to-3D supervision. We outperform the state of the art quantitatively and qualitatively in terms of synthesis quality and resolution, as well as the quality of 3D surface reconstruction.

Zitieren

APA

Habermann, M., Liu, L., Xu, W., Pons-Moll, G., Zollhoefer, M., & Theobalt, C. (2023). HDHumans. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 6(3), 1-23. https://doi.org/10.1145/3606927

Vancouver

Habermann M, Liu L, Xu W, Pons-Moll G, Zollhoefer M, Theobalt C. HDHumans. Proceedings of the ACM on Computer Graphics and Interactive Techniques. 2023;6(3):1-23. doi:10.1145/3606927

BibTeX
@article{Habermann2023,
  author = {Habermann, Marc and Liu, Lingjie and Xu, Weipeng and Pons-Moll, Gerard and Zollhoefer, Michael and Theobalt, Christian},
  title = {HDHumans},
  journal = {Proceedings of the ACM on Computer Graphics and Interactive Techniques},
  year = {2023},
  volume = {6},
  number = {3},
  pages = {1--23},
  doi = {10.1145/3606927}
}
Kostenlos starten →