DynOLAT: OLAT Video Prediction for Controllable Dynamic Full-Body Relighting
ACM Transactions on Graphics · 09.11.2026 · 45 (6) · 1-17
DOI: 10.1145/3842500 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 09.11.2026. Verfasst von Taoming Liu und 9 weiteren Autor:innen. Die Arbeit nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Zhejiang Provincial Natural Science Foundation of China.
Abstract (Originalsprache)
Accurate lighting response is essential for realistic dynamic human relighting, because shadows, highlights, and color changes should follow the target illumination in both direction and relative strength. Current learning-based relighting methods can generate visually plausible videos, but they often exhibit imprecise lighting responses: shadows and highlights may drift away from the target direction, and the output brightness may not faithfully follow the relative intensities in the target environment, making the result closer to appearance harmonization than controllable relighting. To address this issue, we propose DynOLAT, a generalizable OLAT video prediction framework for dynamic full-body humans. Instead of directly synthesizing a single relit appearance, our method predicts temporally consistent One-Light-At-a-Time (OLAT) basis videos from flat-lit inputs, and then linearly combines the predicted bases according to the target environment map. This OLAT-based formulation makes the directional response explicit in the predicted bases, while the relative lighting strength is determined by the linear weights derived from the environment map. We further introduce a dynamic capture pipeline and the first large-scale dynamic full-body OLAT dataset, comprising over 24 million frames from 224 identity-outfit combinations, where different outfits of the same person define separate combinations. Experiments show that DynOLAT responds more faithfully to variations in target lighting direction and relative intensity than the tested baselines, enabling controllable video relighting while preserving fine appearance details and temporal coherence. The dataset and processing tools will be publicly released to foster future research.
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- Zhejiang Provincial Natural Science Foundation of China
Zitieren
APA
Liu, T., ShenTu, Y., He, G., Jin, Y., Ye, Y., Zhang, S., Jia, F., Hua, W., Bao, H., & Zhou, X. (2026). DynOLAT: OLAT Video Prediction for Controllable Dynamic Full-Body Relighting. ACM Transactions on Graphics, 45(6), 1-17. https://doi.org/10.1145/3842500
Vancouver
Liu T, ShenTu Y, He G, Jin Y, Ye Y, Zhang S, et al. DynOLAT: OLAT Video Prediction for Controllable Dynamic Full-Body Relighting. ACM Transactions on Graphics. 2026;45(6):1-17. doi:10.1145/3842500
BibTeX
@article{Liu2026,
author = {Liu, Taoming and ShenTu, Yinji and He, Guangzhao and Jin, Yudong and Ye, Yukang and Zhang, Siyu and Jia, Fan and Hua, Wei and Bao, Hujun and Zhou, Xiaowei},
title = {DynOLAT: OLAT Video Prediction for Controllable Dynamic Full-Body Relighting},
journal = {ACM Transactions on Graphics},
year = {2026},
volume = {45},
number = {6},
pages = {1--17},
doi = {10.1145/3842500}
}
EUVIMED