EUVIMEDObjevte EUVIMED
Crossref

FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement

Zhijie Huang, Jun Sun, Xiaopeng Guo

ACM Transactions on Multimedia Computing, Communications, and Applications · 2023-08-31 · 19 (3) · 1-22

DOI: 10.1145/3569583 ↗

At a glance

Journal article in ACM Transactions on Multimedia Computing, Communications, and Applications, published online on 2023-02-25. Written by Zhijie Huang and 2 co-authors. Cited 12 times so far (Crossref); 53 references. Funded by: National Natural Science Foundation of China.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Deep neural networks have achieved remarkable success in HEVC compressed video quality enhancement. However, most existing multiframe-based methods either deliver unsatisfactory results or consume a significant amount of resources to leverage temporal information of neighboring frames. For the sake of practicality, a thorough investigation of the architecture design of the video quality enhancement network regarding enhancement performance, model parameters, and running speed is essential. In this article, we first propose an efficient alignment module that can quickly and accurately aggregate the spatiotemporal information of neighboring frames. The proposed module estimates deformable offsets progressively in lower-resolution space motivated by the observation of offset correlations between adjacent pixels. Then, the quantization parameter (QP) that represents compression level prior knowledge is utilized to guide aligned feature enhancement. By combining alignment feature distillation with residual feature correction, we obtain an efficient QP attention block. To save the storage space of the network, we design a hash buffer to store QP embedding features. These efficient components allow our network to effectively exploit temporal redundancies and obtain favorable enhancement capability while maintaining a lightweight structure and fast running speed. Extensive experiments demonstrate that the proposed approach outperforms state-of-the-art methods over different QPs by up to 0.09 to 0.11 dB, whereas the inference time can be reduced by up to 69%.

Funding

  • National Natural Science Foundation of China

Cite

APA

Huang, Z., Sun, J., & Guo, X. (2023). FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement. ACM Transactions on Multimedia Computing, Communications, and Applications, 19(3), 1-22. https://doi.org/10.1145/3569583

Vancouver

Huang Z, Sun J, Guo X. FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement. ACM Transactions on Multimedia Computing, Communications, and Applications. 2023;19(3):1-22. doi:10.1145/3569583

BibTeX
@article{Huang2023,
  author = {Huang, Zhijie and Sun, Jun and Guo, Xiaopeng},
  title = {FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2023},
  volume = {19},
  number = {3},
  pages = {1--22},
  doi = {10.1145/3569583}
}
Start for free →