EUVIMEDEUVIMED entdecken
Crossref

Dream4D: Lifting Camera‐Controlled I2V towards Spatiotemporally Consistent 4D Generation

Xiaoyan Liu, Kangrui Li, Jiaxin Liu, Yuehao Song, Yujie Xin

Computer Graphics Forum · 14.11.2026

DOI: 10.1111/cgf.70617 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 14.11.2026. Verfasst von Xiaoyan Liu und 4 weiteren Autor:innen. Die Arbeit nennt 57 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generating spatiotemporally consistent 4D content requires joint modeling of high‐fidelity spatial details and realistic temporal dynamics. However, existing methods typically lack world knowledge learned from expansive 4D observations. As a result, generated scenes often struggle to maintain pose and temporal consistency in complex dynamic environments, leading to degraded generation quality. To address these challenges, we propose Dream4D , a novel 4D generation framework that integrates spatiotemporal priors from video generation with explicit sequential camera control. Our method adopts a three‐stage pipeline. We first employ a vision–language model (VLM) to determine the camera trajectory that best captures the intended view from the input image and the instruction text. Next, a pose‐conditioned diffusion model generates geometrically consistent image sequences along this trajectory. Finally, we use an advanced 4D generator to reconstruct a coherent and persistent 4D representation conditioned on the generated video. Dream4D jointly leverages the rich temporal priors of video diffusion models and the geometric awareness of reconstruction models to achieve high‐quality image‐to‐4D generation. Extensive experiments demonstrate that our approach significantly outperforms existing methods in both pose and temporal consistency.

Zitieren

APA

Liu, X., Li, K., Liu, J., Song, Y., & Xin, Y. (2026). Dream4D: Lifting Camera‐Controlled I2V towards Spatiotemporally Consistent 4D Generation. Computer Graphics Forum. https://doi.org/10.1111/cgf.70617

Vancouver

Liu X, Li K, Liu J, Song Y, Xin Y. Dream4D: Lifting Camera‐Controlled I2V towards Spatiotemporally Consistent 4D Generation. Computer Graphics Forum. 2026. doi:10.1111/cgf.70617

BibTeX
@article{Liu2026,
  author = {Liu, Xiaoyan and Li, Kangrui and Liu, Jiaxin and Song, Yuehao and Xin, Yujie},
  title = {Dream4D: Lifting Camera‐Controlled I2V towards Spatiotemporally Consistent 4D Generation},
  journal = {Computer Graphics Forum},
  year = {2026},
  doi = {10.1111/cgf.70617}
}
Kostenlos starten →