FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2023 · 19 (3) · 1-22
DOI: 10.1145/3569583 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 25.02.2023. Verfasst von Zhijie Huang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Deep neural networks have achieved remarkable success in HEVC compressed video quality enhancement. However, most existing multiframe-based methods either deliver unsatisfactory results or consume a significant amount of resources to leverage temporal information of neighboring frames. For the sake of practicality, a thorough investigation of the architecture design of the video quality enhancement network regarding enhancement performance, model parameters, and running speed is essential. In this article, we first propose an efficient alignment module that can quickly and accurately aggregate the spatiotemporal information of neighboring frames. The proposed module estimates deformable offsets progressively in lower-resolution space motivated by the observation of offset correlations between adjacent pixels. Then, the quantization parameter (QP) that represents compression level prior knowledge is utilized to guide aligned feature enhancement. By combining alignment feature distillation with residual feature correction, we obtain an efficient QP attention block. To save the storage space of the network, we design a hash buffer to store QP embedding features. These efficient components allow our network to effectively exploit temporal redundancies and obtain favorable enhancement capability while maintaining a lightweight structure and fast running speed. Extensive experiments demonstrate that the proposed approach outperforms state-of-the-art methods over different QPs by up to 0.09 to 0.11 dB, whereas the inference time can be reduced by up to 69%.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Huang, Z., Sun, J., & Guo, X. (2023). FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement. ACM Transactions on Multimedia Computing, Communications, and Applications, 19(3), 1-22. https://doi.org/10.1145/3569583
Vancouver
Huang Z, Sun J, Guo X. FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement. ACM Transactions on Multimedia Computing, Communications, and Applications. 2023;19(3):1-22. doi:10.1145/3569583
BibTeX
@article{Huang2023,
author = {Huang, Zhijie and Sun, Jun and Guo, Xiaopeng},
title = {FastCNN: Towards Fast and Accurate Spatiotemporal Network for HEVC Compressed Video Enhancement},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2023},
volume = {19},
number = {3},
pages = {1--22},
doi = {10.1145/3569583}
}
EUVIMED