Blind Quality Assessment of Wide-Angle Videos Based on Deformation Representation Learning and Multi-Dimensional Feature Fusion
IEEE Transactions on Circuits and Systems for Video Technology · 2025-12 · 35 (12) · 12227-12237
DOI: 10.1109/tcsvt.2025.3585993 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-12. Verfasst von Bo Hu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: Chongqing Natural Science Foundation Innovation and Development Joint Fund Project, National Natural Science Foundation of China, Science and Technology Research Program of Chongqing Municipal Education Commission.
Abstract (Originalsprache)
Wide-angle videos shot with short-focus lenses often exhibit deformation distortions, which poses significant challenges for video quality assessment (VQA). Although current VQA methods focus primarily on video content and distortion perception, there has been little explicit research on the impact of deformation characteristics on the perception of wide-angle video quality. To this end, this paper makes the first attempt to construct a novel wide-angle video quality assessment method based on deformation representation learning and multi-dimensional feature fusion, termed DRLMF. Specifically, we first analyze the deformation distribution characteristics of wide-angle videos based on the deformation camera model. Based on this, a three-stream video perception and assessment network is proposed. The first branch extracts global semantics using the image encoder of CLIP. The second branch introduces an effective deformation region selection strategy and proposes an interpretable deformation representation learning module. This module leverages the perception advantages of convolutional neural networks (CNNs) in local distortions and considers the correlation between patch size and distortion perception. The third branch extracts motion features using an action recognition network. Finally, an effective multi-dimensional feature fusion module is proposed to integrate more refined and richer semantic, deformation, and motion features. Extensive experiments on wide-angle VQA datasets and standard video datasets show that the DRLMF outperforms the state-of-the-arts in terms of prediction monotonicity and accuracy. The codes will be available at https://github.com/BoHu90/DRLMF
Förderung
- Chongqing Natural Science Foundation Innovation and Development Joint Fund Project
- National Natural Science Foundation of China
- Science and Technology Research Program of Chongqing Municipal Education Commission
- Chongqing Postdoctoral Research Project Special Support
- Natural Science Foundation of Chongqing Municipality
Zitieren
APA
Hu, B., Wang, W., Li, L., He, L., Lu, W., & Gao, X. (2025). Blind Quality Assessment of Wide-Angle Videos Based on Deformation Representation Learning and Multi-Dimensional Feature Fusion. IEEE Transactions on Circuits and Systems for Video Technology, 35(12), 12227-12237. https://doi.org/10.1109/tcsvt.2025.3585993
Vancouver
Hu B, Wang W, Li L, He L, Lu W, Gao X. Blind Quality Assessment of Wide-Angle Videos Based on Deformation Representation Learning and Multi-Dimensional Feature Fusion. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(12):12227-12237. doi:10.1109/tcsvt.2025.3585993
BibTeX
@article{Hu2025,
author = {Hu, Bo and Wang, Wei and Li, Leida and He, Lihuo and Lu, Wen and Gao, Xinbo},
title = {Blind Quality Assessment of Wide-Angle Videos Based on Deformation Representation Learning and Multi-Dimensional Feature Fusion},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {12},
pages = {12227--12237},
doi = {10.1109/tcsvt.2025.3585993}
}
EUVIMED