EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Learning a Delighting Prior for Facial Appearance Capture in the Wild

Yuxuan Han, Xin Ming, Tianxiao Li, Zhuofan Shen, Qixuan Zhang, Lan Xu, Feng Xu

ACM Transactions on Graphics · 03.07.2026 · 45 (4) · 1-15

DOI: 10.1145/3811303 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 03.07.2026. Verfasst von Yuxuan Han und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

High-quality facial appearance capture has traditionally required costly studio recording. Recent works consider an in-the-wild smartphone-based setup; however, their model-based inverse rendering paradigm struggles with the complex disentanglement of reflectance from unknown illumination. To bridge this gap, we propose to shift the paradigm into training a powerful delighting network as a prior to constrain the optimization. We leverage the OLAT dataset and the rendered Light Stage scans for training, and propose Dataset Latent Modulation (DLM) to seamlessly integrate these heterogeneous data sources. Specifically, by conditioning the core network on learnable source-aware tokens, we decouple dataset-specific styles from physical delighting principles, enabling the emergence of a delighting prior that outperforms existing proprietary models. This powerful delighting prior enables a simple and automatic appearance capture pipeline that achieves high-quality reflectance estimation from casual video inputs, outperforming prior arts by a large margin. Furthermore, we leverage our appearance capture method to transform the multi-view NeRSemble dataset into NeRSemble-Scan, a large-scale collection of 4K-resolution relightable scans. By open-sourcing our model and the NeRSemble-Scan dataset, we democratize high-end facial capture and provide a new foundation for the research community to build photorealistic digital humans.

Zitieren

APA

Han, Y., Ming, X., Li, T., Shen, Z., Zhang, Q., Xu, L., & Xu, F. (2026). Learning a Delighting Prior for Facial Appearance Capture in the Wild. ACM Transactions on Graphics, 45(4), 1-15. https://doi.org/10.1145/3811303

Vancouver

Han Y, Ming X, Li T, Shen Z, Zhang Q, Xu L, et al. Learning a Delighting Prior for Facial Appearance Capture in the Wild. ACM Transactions on Graphics. 2026;45(4):1-15. doi:10.1145/3811303

BibTeX
@article{Han2026,
  author = {Han, Yuxuan and Ming, Xin and Li, Tianxiao and Shen, Zhuofan and Zhang, Qixuan and Xu, Lan and Xu, Feng},
  title = {Learning a Delighting Prior for Facial Appearance Capture in the Wild},
  journal = {ACM Transactions on Graphics},
  year = {2026},
  volume = {45},
  number = {4},
  pages = {1--15},
  doi = {10.1145/3811303}
}
Kostenlos starten →