The Bjøntegaard Bible Why Your Way of Comparing Video Codecs May Be Wrong
IEEE Transactions on Image Processing · 2024 · 33 · 987-1001
DOI: 10.1109/tip.2023.3346695 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Christian Herglotz und 10 weiteren Autor:innen. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 75 Literaturangaben.
Abstract (Originalsprache)
In this paper, we provide an in-depth assessment on the Bjøntegaard Delta. We construct a large data set of video compression performance comparisons using a diverse set of metrics including PSNR, VMAF, bitrate, and processing energies. These metrics are evaluated for visual data types such as classic perspective video, 360° video, point clouds, and screen content. As compression technology, we consider multiple hybrid video codecs as well as state-of-the-art neural network based compression methods. Using additional supporting points in-between standard points defined by parameters such as the quantization parameter, we assess the interpolation error of the Bjøntegaard-Delta (BD) calculus and its impact on the final BD value. From the analysis, we find that the BD calculus is most accurate in the standard application of rate-distortion comparisons with mean errors below 0.5 percentage points. For other applications and special cases, e.g., VMAF quality, energy considerations, or inter-codec comparisons, the errors are higher (up to 5 percentage points), but can be halved by using a higher number of supporting points. We finally come up with recommendations on how to use the BD calculus such that the validity of the resulting BD-values is maximized. Main recommendations are as follows: First, relative curve differences should be plotted and analyzed. Second, the logarithmic domain should be used for saturating metrics such as SSIM and VMAF. Third, BD values below a certain threshold indicated by the subset error should not be used to draw recommendations. Fourth, using two supporting points is sufficient to obtain rough performance estimates.
Zitieren
APA
Herglotz, C., Och, H., Meyer, A., Ramasubbu, G., Eichermuller, L., Kranzler, M., Brand, F., Fischer, K., Nguyen, D. T., Regensky, A., & Kaup, A. (2024). The Bjøntegaard Bible Why Your Way of Comparing Video Codecs May Be Wrong. IEEE Transactions on Image Processing, 33, 987-1001. https://doi.org/10.1109/tip.2023.3346695
Vancouver
Herglotz C, Och H, Meyer A, Ramasubbu G, Eichermuller L, Kranzler M, et al. The Bjøntegaard Bible Why Your Way of Comparing Video Codecs May Be Wrong. IEEE Transactions on Image Processing. 2024;33:987-1001. doi:10.1109/tip.2023.3346695
BibTeX
@article{Herglotz2024,
author = {Herglotz, Christian and Och, Hannah and Meyer, Anna and Ramasubbu, Geetha and Eichermuller, Lena and Kranzler, Matthias and Brand, Fabian and Fischer, Kristian and Nguyen, Dat Thanh and Regensky, Andy and Kaup, Andre},
title = {The Bjøntegaard Bible Why Your Way of Comparing Video Codecs May Be Wrong},
journal = {IEEE Transactions on Image Processing},
year = {2024},
volume = {33},
pages = {987--1001},
doi = {10.1109/tip.2023.3346695}
}
EUVIMED