A Video Frame Prediction Method Based on Latent-Space Autoregressive Modeling
Applied Sciences · 01.05.2026 · 16 (9) · 4423
DOI: 10.3390/app16094423 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 01.05.2026. Verfasst von Congcong Zhang und 5 weiteren Autor:innen. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science & Technology Commission of Shanghai Municipality (STCSM), China.
Abstract (Originalsprache)
Video prediction is a fundamental task in computer vision with broad applications in intelligent robotics, autonomous driving, and related fields. However, existing methods often struggle to simultaneously model long-term temporal dependencies, preserve local details, and alleviate error accumulation during autoregressive prediction. To address these issues, this paper proposes a two-stage video prediction framework composed of a HybridResSwin Autoencoder (HRS-AE) and an Enhanced FAR Transformer (EFAR). In the first stage, HRS-AE learns compact and discriminative latent representations from input video frames while preserving essential spatial structures and fine-grained details. In the second stage, EFAR performs autoregressive temporal prediction in the latent space, and the predicted latent representations are then decoded to reconstruct future video frames. Experiments on the KTH, BAIR, and Moving MNIST datasets show that the proposed method achieves competitive performance under the adopted evaluation protocol. Specifically, the proposed framework achieves a PSNR of 30.27 dB and an LPIPS of 0.0722 on KTH, a PSNR of 20.95 dB on BAIR, and an SSIM of 0.961 with an MSE of 22.9 on Moving MNIST. In addition, ablation studies further indicate that the proposed components contribute to latent representation learning and long-horizon prediction stability. These results suggest that the proposed framework provides a promising approach for video prediction with favorable reconstruction quality, perceptual consistency, and temporal coherence.
Förderung
- Science & Technology Commission of Shanghai Municipality (STCSM), China
Zitieren
APA
Zhang, C., Tian, J., Gong, L., Zhang, Y., Wu, F., & Pan, H. (2026). A Video Frame Prediction Method Based on Latent-Space Autoregressive Modeling. Applied Sciences, 16(9), 4423. https://doi.org/10.3390/app16094423
Vancouver
Zhang C, Tian J, Gong L, Zhang Y, Wu F, Pan H. A Video Frame Prediction Method Based on Latent-Space Autoregressive Modeling. Applied Sciences. 2026;16(9):4423. doi:10.3390/app16094423
BibTeX
@article{Zhang2026,
author = {Zhang, Congcong and Tian, Jin and Gong, Lihua and Zhang, Yujin and Wu, Fei and Pan, Han},
title = {A Video Frame Prediction Method Based on Latent-Space Autoregressive Modeling},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {9},
pages = {4423},
doi = {10.3390/app16094423}
}
EUVIMED