EUVIMEDEUVIMED entdecken
Crossref

Real‐time Neural Rendering of Dynamic Light Fields

Arno Coomans, Edoardo A. Dominci, Christian Döring, Joerg H. Mueller, Jozef Hladky, Markus Steinberger

Computer Graphics Forum · 2024-05 · 43 (2)

DOI: 10.1111/cgf.15014 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 23.04.2024. Verfasst von Arno Coomans und 5 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 73 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Synthesising high‐quality views of dynamic scenes via path tracing is prohibitively expensive. Although caching offline‐quality global illumination in neural networks alleviates this issue, existing neural view synthesis methods are limited to mainly static scenes, have low inference performance or do not integrate well with existing rendering paradigms. We propose a novel neural method that is able to capture a dynamic light field, renders at real‐time frame rates at 1920×1080 resolution and integrates seamlessly with Monte Carlo ray tracing frameworks. We demonstrate how a combination of spatial, temporal and a novel surface‐space encoding are each effective at capturing different kinds of spatio‐temporal signals. Together with a compact fully‐fused neural network and architectural improvements, we achieve a twenty‐fold increase in network inference speed compared to related methods at equal or better quality. Our approach is suitable for providing offline‐quality real‐time rendering in a variety of scenarios, such as free‐viewpoint video, interactive multi‐view rendering, or streaming rendering. Finally, our work can be integrated into other rendering paradigms, e.g., providing a dynamic background for interactive scenarios where the foreground is rendered with traditional methods.

Zitieren

APA

Coomans, A., Dominci, E. A., Döring, C., Mueller, J. H., Hladky, J., & Steinberger, M. (2024). Real‐time Neural Rendering of Dynamic Light Fields. Computer Graphics Forum, 43(2). https://doi.org/10.1111/cgf.15014

Vancouver

Coomans A, Dominci EA, Döring C, Mueller JH, Hladky J, Steinberger M. Real‐time Neural Rendering of Dynamic Light Fields. Computer Graphics Forum. 2024;43(2). doi:10.1111/cgf.15014

BibTeX
@article{Coomans2024,
  author = {Coomans, Arno and Dominci, Edoardo A. and Döring, Christian and Mueller, Joerg H. and Hladky, Jozef and Steinberger, Markus},
  title = {Real‐time Neural Rendering of Dynamic Light Fields},
  journal = {Computer Graphics Forum},
  year = {2024},
  volume = {43},
  number = {2},
  doi = {10.1111/cgf.15014}
}
Kostenlos starten →