EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

PlayLife: Tracking-Shot Video Generation

Yuanpeng Tu

International Journal of Computer Vision · 2026-06 · 134 (6)

DOI: 10.1007/s11263-026-02837-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Vision, online erschienen am 11.05.2026. Verfasst von Yuanpeng Tu. Die Arbeit nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Tracking shot videos, where a third person camera follows a moving subject, are central to games and cinematography and are increasingly useful for simulation, content creation, and embodied evaluation. However, existing controllable video generators often rely on text or coarse global cues. In addition, their motion transfer pipelines typically assume a fixed viewpoint, and game specific systems frequently discretize movement. Consequently, producing third person videos with free human level motion and consistent camera tracking from minimal inputs remains underexplored. To address these issues, we present PlayLife, a tracking shot image to video generator. Specifically, given a single exocentric image and a human motion sequence, it synthesizes third person videos in which a virtual camera consistently follows the actor while the generated motion adheres to the provided actions across AAA game and real world scenes. At the core is a geometry-aware action injection module. Concretely, articulated keypoints from the motion sequence are projected into the first frame using estimated camera parameters and are fused with video latents through cross attention. Through this design, the model achieves part level correspondence, stable trajectories, and scene aware view control. To learn from scarce and noisy supervision, we adopt hierarchical training . In the first stage, lightweight temporal adapters are pretrained on a large corpus with paired motion and video data; in the second stage, they are finetuned on a curated subset with a pose aware reconstruction loss that emphasizes articulated foreground regions, thereby improving temporal synchronization and motion fidelity. Finally, we curate tracking shot data and establish evaluation protocols in both game and real world settings. Furthermore, experiments with visualizations, automatic metrics, and user studies show strong controllability, accurate alignment between motion and camera view, high perceptual realism, and robust generalization from minimal inputs.

Zitieren

APA

Tu, Y. (2026). PlayLife: Tracking-Shot Video Generation. International Journal of Computer Vision, 134(6). https://doi.org/10.1007/s11263-026-02837-9

Vancouver

Tu Y. PlayLife: Tracking-Shot Video Generation. International Journal of Computer Vision. 2026;134(6). doi:10.1007/s11263-026-02837-9

BibTeX
@article{Tu2026,
  author = {Tu, Yuanpeng},
  title = {PlayLife: Tracking-Shot Video Generation},
  journal = {International Journal of Computer Vision},
  year = {2026},
  volume = {134},
  number = {6},
  doi = {10.1007/s11263-026-02837-9}
}
Kostenlos starten →