Learning-Based Fast Splitting and Directional Mode Decision for VVC Intra Prediction
IEEE Transactions on Broadcasting · 2024-06 · 70 (2) · 681-692
DOI: 10.1109/tbc.2024.3360729 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Broadcasting, 2024-06. Verfasst von Yuanyuan Huang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 38 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, Science and Technology Research Program of Chongqing Municipal Education Commission.
Abstract (Originalsprache)
As the latest video coding standard, Versatile Video Coding (VVC) is highly efficient at the cost of very high coding complexity, which seriously hinders its practical application. Therefore, it is very crucial to improve its coding speed. In this paper, we propose a learning-based fast split mode (SM) and directional mode (DM) decision algorithm for VVC intra prediction using a deep learning approach. Specifically, given the observation that the SM distributions of coding units (CUs) of different sizes are significantly distinct, we first design the neural networks separately and train the SM models for all CUs of different sizes to obtain the probability of SMs and skip the unlikely ones. Second, given a similar observation that the DM distributions of CUs of different sizes are distinct, we design neural networks to train the DM models for all CUs of different sizes separately to obtain the probabilities of DMs, and then adaptively select candidate DMs based on probabilities of their located SMs. Third, after an SM is checked, we select its probability, residual coefficients, rate-distortion (RD) cost, etc. as features, and design a lightweight neural network (LNN) model to early terminate SM selection. Experimental results demonstrate that the proposed algorithm can reduce the encoding time of VVC by 70.73% with 2.44% increase in Bjøntegaard delta bit-rate (BDBR) on average.
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- Science and Technology Research Program of Chongqing Municipal Education Commission
- Natural Science Foundation of Sichuan Province
- Guizhou Provincial Basic Research Program
- Guangxi Key Laboratory of Machine Vision and Intelligent Control
Zitieren
APA
Huang, Y., Yu, J., Wang, D., Lu, X., Dufaux, F., Guo, H., & Zhu, C. (2024). Learning-Based Fast Splitting and Directional Mode Decision for VVC Intra Prediction. IEEE Transactions on Broadcasting, 70(2), 681-692. https://doi.org/10.1109/tbc.2024.3360729
Vancouver
Huang Y, Yu J, Wang D, Lu X, Dufaux F, Guo H, et al. Learning-Based Fast Splitting and Directional Mode Decision for VVC Intra Prediction. IEEE Transactions on Broadcasting. 2024;70(2):681-692. doi:10.1109/tbc.2024.3360729
BibTeX
@article{Huang2024,
author = {Huang, Yuanyuan and Yu, Junyi and Wang, Dayong and Lu, Xin and Dufaux, Frederic and Guo, Hui and Zhu, Ce},
title = {Learning-Based Fast Splitting and Directional Mode Decision for VVC Intra Prediction},
journal = {IEEE Transactions on Broadcasting},
year = {2024},
volume = {70},
number = {2},
pages = {681--692},
doi = {10.1109/tbc.2024.3360729}
}
EUVIMED