EUVIMEDEUVIMED entdecken
Crossref

Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation

Liang Liao, Kangmin Xu, Haoning Wu, Chaofeng Chen, Wenxiu Sun, Qiong Yan, C-C Jay Kuo, Weisi Lin

IEEE Transactions on Image Processing · 2024

DOI: 10.1109/tip.2024.3445738 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Liang Liao und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Video Recording, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 81 Literaturangaben. Gefördert von: RIE2020 Industry Alignment Fund–Industry Collaboration Projects (IAF-ICP) Funding Initiative, National Natural Science Foundation of China, Young Elite Scientists Sponsorship Program by CAST.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Blind video quality assessment (VQA) has become an increasingly demanding problem in automatically assessing the quality of ever-growing in-the-wild videos. Although efforts have been made to measure temporal distortions, the core to distinguish between VQA and image quality assessment (IQA), the lack of modeling of how the human visual system (HVS) relates to the temporal quality of videos hinders the precise mapping of predicted temporal scores to the human perception. Inspired by the recent discovery of the temporal straightness law of natural videos in the HVS, this paper intends to model the complex temporal distortions of in-the-wild videos in a simple and uniform representation by describing the geometric properties of videos in the visual perceptual domain. A novel videolet, with perceptual representation embedding of a few consecutive frames, is designed as the basic quality measurement unit to quantify temporal distortions by measuring the angular and linear displacements from the straightness law. By combining the predicted score on each videolet, a perceptually temporal quality evaluator (PTQE) is formed to measure the temporal quality of the entire video. Experimental results demonstrate that the perceptual representation in the HVS is an efficient way of predicting subjective temporal quality. Moreover, when combined with spatial quality metrics, PTQE achieves top performance over popular in-the-wild video datasets. More importantly, PTQE requires no additional information beyond the video being assessed, making it applicable to any dataset without parameter tuning. Additionally, the generalizability of PTQE is evaluated on video frame interpolation tasks, demonstrating its potential to benefit temporal-related enhancement tasks.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Video RecordingImage Processing, Computer-AssistedHumansVisual PerceptionAlgorithms

Förderung

  • RIE2020 Industry Alignment Fund–Industry Collaboration Projects (IAF-ICP) Funding Initiative
  • National Natural Science Foundation of China
  • Young Elite Scientists Sponsorship Program by CAST

Zitieren

APA

Liao, L., Xu, K., Wu, H., Chen, C., Sun, W., Yan, Q., Jay Kuo, C. C., & Lin, W. (2024). Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2024.3445738

Vancouver

Liao L, Xu K, Wu H, Chen C, Sun W, Yan Q, et al. Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation. IEEE Transactions on Image Processing. 2024. doi:10.1109/tip.2024.3445738

BibTeX
@article{Liao2024,
  author = {Liao, Liang and Xu, Kangmin and Wu, Haoning and Chen, Chaofeng and Sun, Wenxiu and Yan, Qiong and Jay Kuo, C-C and Lin, Weisi},
  title = {Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation},
  journal = {IEEE Transactions on Image Processing},
  year = {2024},
  doi = {10.1109/tip.2024.3445738}
}
Kostenlos starten →