EUVIMEDEUVIMED entdecken
Crossref

FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement

Zhijie Huang, Jun Sun, Xiaopeng Guo

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2023 · 19 (3) · 1-22

DOI: 10.1145/3569583 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 25.02.2023. Verfasst von Zhijie Huang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep neural networks have achieved remarkable success in HEVC compressed video quality enhancement. However, most existing multiframe-based methods either deliver unsatisfactory results or consume a significant amount of resources to leverage temporal information of neighboring frames. For the sake of practicality, a thorough investigation of the architecture design of the video quality enhancement network regarding enhancement performance, model parameters, and running speed is essential. In this article, we first propose an efficient alignment module that can quickly and accurately aggregate the spatiotemporal information of neighboring frames. The proposed module estimates deformable offsets progressively in lower-resolution space motivated by the observation of offset correlations between adjacent pixels. Then, the quantization parameter (QP) that represents compression level prior knowledge is utilized to guide aligned feature enhancement. By combining alignment feature distillation with residual feature correction, we obtain an efficient QP attention block. To save the storage space of the network, we design a hash buffer to store QP embedding features. These efficient components allow our network to effectively exploit temporal redundancies and obtain favorable enhancement capability while maintaining a lightweight structure and fast running speed. Extensive experiments demonstrate that the proposed approach outperforms state-of-the-art methods over different QPs by up to 0.09 to 0.11 dB, whereas the inference time can be reduced by up to 69%.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Huang, Z., Sun, J., & Guo, X. (2023). FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement. ACM Transactions on Multimedia Computing, Communications, and Applications, 19(3), 1-22. https://doi.org/10.1145/3569583

Vancouver

Huang Z, Sun J, Guo X. FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement. ACM Transactions on Multimedia Computing, Communications, and Applications. 2023;19(3):1-22. doi:10.1145/3569583

BibTeX
@article{Huang2023,
  author = {Huang, Zhijie and Sun, Jun and Guo, Xiaopeng},
  title = {FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2023},
  volume = {19},
  number = {3},
  pages = {1--22},
  doi = {10.1145/3569583}
}
Kostenlos starten →