EUVIMEDEUVIMED entdecken
Crossref

Advancing Learned Video Compression With In-Loop Frame Prediction

Ren Yang, Radu Timofte, Luc Van Gool

IEEE Transactions on Circuits and Systems for Video Technology · 2023-05 · 33 (5) · 2410-2423

DOI: 10.1109/tcsvt.2022.3222418 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2023-05. Verfasst von Ren Yang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: ETH Zurich General Fund, Alexander von Humboldt-Stiftung.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent years have witnessed an increasing interest in end-to-end learned video compression. Most previous works explore temporal redundancy by detecting and compressing a motion map to warp the reference frame towards the target frame. Yet, it failed to adequately take advantage of the historical priors in the sequential reference frames. In this paper, we propose an Advanced Learned Video Compression (ALVC) approach with the in-loop frame prediction module, which is able to effectively predict the target frame from the previously compressed frames, without consuming any bit-rate. The predicted frame can serve as a better reference than the previously compressed frame, and therefore it benefits the compression performance. The proposed in-loop prediction module is a part of the end-to-end video compression and is jointly optimized in the whole framework. We propose the recurrent and the bi-directional in-loop prediction modules for compressing P-frames and B-frames, respectively. The experiments show the state-of-the-art performance of our ALVC approach in learned video compression. We also outperform the default hierarchical B mode of x265 in terms of PSNR and beat the slowest mode of the SSIM-tuned x265 on MS-SSIM. The project page: https://github.com/RenYang-home/ALVC.

Förderung

  • ETH Zurich General Fund
  • Alexander von Humboldt-Stiftung

Zitieren

APA

Yang, R., Timofte, R., & Gool, L. V. (2023). Advancing Learned Video Compression With In-Loop Frame Prediction. IEEE Transactions on Circuits and Systems for Video Technology, 33(5), 2410-2423. https://doi.org/10.1109/tcsvt.2022.3222418

Vancouver

Yang R, Timofte R, Gool LV. Advancing Learned Video Compression With In-Loop Frame Prediction. IEEE Transactions on Circuits and Systems for Video Technology. 2023;33(5):2410-2423. doi:10.1109/tcsvt.2022.3222418

BibTeX
@article{Yang2023,
  author = {Yang, Ren and Timofte, Radu and Gool, Luc Van},
  title = {Advancing Learned Video Compression With In-Loop Frame Prediction},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2023},
  volume = {33},
  number = {5},
  pages = {2410--2423},
  doi = {10.1109/tcsvt.2022.3222418}
}
Kostenlos starten →