Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation
IEEE Transactions on Image Processing · 2024
DOI: 10.1109/tip.2024.3445738 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Liang Liao und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Video Recording, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 81 Literaturangaben. Gefördert von: RIE2020 Industry Alignment Fund–Industry Collaboration Projects (IAF-ICP) Funding Initiative, National Natural Science Foundation of China, Young Elite Scientists Sponsorship Program by CAST.
Abstract (Originalsprache)
Blind video quality assessment (VQA) has become an increasingly demanding problem in automatically assessing the quality of ever-growing in-the-wild videos. Although efforts have been made to measure temporal distortions, the core to distinguish between VQA and image quality assessment (IQA), the lack of modeling of how the human visual system (HVS) relates to the temporal quality of videos hinders the precise mapping of predicted temporal scores to the human perception. Inspired by the recent discovery of the temporal straightness law of natural videos in the HVS, this paper intends to model the complex temporal distortions of in-the-wild videos in a simple and uniform representation by describing the geometric properties of videos in the visual perceptual domain. A novel videolet, with perceptual representation embedding of a few consecutive frames, is designed as the basic quality measurement unit to quantify temporal distortions by measuring the angular and linear displacements from the straightness law. By combining the predicted score on each videolet, a perceptually temporal quality evaluator (PTQE) is formed to measure the temporal quality of the entire video. Experimental results demonstrate that the perceptual representation in the HVS is an efficient way of predicting subjective temporal quality. Moreover, when combined with spatial quality metrics, PTQE achieves top performance over popular in-the-wild video datasets. More importantly, PTQE requires no additional information beyond the video being assessed, making it applicable to any dataset without parameter tuning. Additionally, the generalizability of PTQE is evaluated on video frame interpolation tasks, demonstrating its potential to benefit temporal-related enhancement tasks.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- RIE2020 Industry Alignment Fund–Industry Collaboration Projects (IAF-ICP) Funding Initiative
- National Natural Science Foundation of China
- Young Elite Scientists Sponsorship Program by CAST
Zitieren
APA
Liao, L., Xu, K., Wu, H., Chen, C., Sun, W., Yan, Q., Jay Kuo, C. C., & Lin, W. (2024). Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2024.3445738
Vancouver
Liao L, Xu K, Wu H, Chen C, Sun W, Yan Q, et al. Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation. IEEE Transactions on Image Processing. 2024. doi:10.1109/tip.2024.3445738
BibTeX
@article{Liao2024,
author = {Liao, Liang and Xu, Kangmin and Wu, Haoning and Chen, Chaofeng and Sun, Wenxiu and Yan, Qiong and Jay Kuo, C-C and Lin, Weisi},
title = {Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation},
journal = {IEEE Transactions on Image Processing},
year = {2024},
doi = {10.1109/tip.2024.3445738}
}
EUVIMED