EUVIMEDEUVIMED entdecken
Crossref

End-to-End Deep Video Compression Based on Hierarchical Temporal Context Learning

Kejun Wu, Zhenxing Li, You Yang, Qiong Liu, Xiao-Ping Zhang

IEEE Transactions on Multimedia · 2025 · 27 · 4386-4399

DOI: 10.1109/tmm.2025.3535367 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Multimedia, 2025. Verfasst von Kejun Wu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: Hubei Province Key R&D Program, Shenzhen Ubiquitous Data Enabling Key Lab, Tsinghua Shenzhen International Graduate School-Shenzhen Pengrui Endowed Professorship Scheme of Shenzhen Pengrui Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emerging learning-based video compression suffers from error propagation in long group of pictures (GOP), yielding limited coding performance. To address this problem, a novel end-to-end Deep Video Compression method based on Hierarchical Temporal Context Learning (DVCH) is proposed in this paper. DVCH aims to fully exploit temporal contexts and suppress error propagation for better coding performance. It first divides video frames into several hierarchies with different compression qualities. The frames in lower hierarchies have high compression quality, and serve as reference frames. To mine high-quality reference information, we propose a Hierarchical Temporal Context Learning (HTCL) network as the fundamental module of our DVCH. The informative temporal context features from hierarchical prediction structure can be extracted by the network. Motion vectors (MVs) between the to-be-coded frame and its reference frames are estimated by the MV Learning module and used to align the extracted contexts. The contexts are fed into Context Coding module to generate the prediction of the decoded frame. Moreover, a multi-stage training strategy is developed to solve the imbalanced training challenge. Experimental results demonstrate that the proposed DVCH exceeds x264 and other end-to-end video compression methods, regardless of objective, subjective, error propagation suppression, GOP sizes, and sequence length evaluations. As much as 49.27% bitrate savings and 2.52 dB PSNR gains can be achieved in large GOP.

Förderung

  • Hubei Province Key R&D Program
  • Shenzhen Ubiquitous Data Enabling Key Lab
  • Tsinghua Shenzhen International Graduate School-Shenzhen Pengrui Endowed Professorship Scheme of Shenzhen Pengrui Foundation
  • Fundamental Research Program of HUST

Zitieren

APA

Wu, K., Li, Z., Yang, Y., Liu, Q., & Zhang, X. (2025). End-to-End Deep Video Compression Based on Hierarchical Temporal Context Learning. IEEE Transactions on Multimedia, 27, 4386-4399. https://doi.org/10.1109/tmm.2025.3535367

Vancouver

Wu K, Li Z, Yang Y, Liu Q, Zhang X. End-to-End Deep Video Compression Based on Hierarchical Temporal Context Learning. IEEE Transactions on Multimedia. 2025;27:4386-4399. doi:10.1109/tmm.2025.3535367

BibTeX
@article{Wu2025,
  author = {Wu, Kejun and Li, Zhenxing and Yang, You and Liu, Qiong and Zhang, Xiao-Ping},
  title = {End-to-End Deep Video Compression Based on Hierarchical Temporal Context Learning},
  journal = {IEEE Transactions on Multimedia},
  year = {2025},
  volume = {27},
  pages = {4386--4399},
  doi = {10.1109/tmm.2025.3535367}
}
Kostenlos starten →