EUVIMEDEUVIMED entdecken
Crossref

Dynamic Expert-Knowledge Ensemble for Generalizable Video Quality Assessment

Pengfei Chen, Leida Li, Haoliang Li, Jinjian Wu, Weisheng Dong, Guangming Shi

IEEE Transactions on Circuits and Systems for Video Technology · 2023-06 · 33 (6) · 2577-2589

DOI: 10.1109/tcsvt.2022.3225552 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2023-06. Verfasst von Pengfei Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Project of Shaanxi Provincial Department of Education.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Despite the impressive progress of supervised methods in quality assessment for in- the-wild videos, models trained on one domain often fail to generalize well to others due to the domain shifts caused by distortion diversity and content variation. Domain generalizable video quality assessment (VQA) methods that can work across domains remain an open research challenge. Although combining more data following the mixed-domain training strategy can improve the generalization performance to a certain extent, the specific knowledge from each source domain, which could potentially be useful for improving unseen domain generalization, is ignored in this principle. Motivated by this, we propose a domain generalizable VQA method named Dynamic Ensemble of Expert-Knowledge (DEEK), a novel framework that dynamically exploits the expert-knowledge from each source domain to achieve a generalizable ensemble prediction. Specifically, based on the multiple experts each trained to specialize in a particular source domain, we aim to exploit complementary information provided by the expert-knowledge. We effectively train an ensemble model by proposing a quality-sensitive InfoNCE loss to regularize the collaborative training of all experts in the contrastive learning formulation, aiming to exploit complementary information provided by the expert-knowledge when forming the ensemble. By dynamically integrating the experts according to their relevances to the target data, these expert-knowledge could be leveraged for better generalization. Experiments on five VQA datasets verify that our approach outperforms the state-of-the-arts by large margins.

Förderung

  • National Natural Science Foundation of China
  • Key Project of Shaanxi Provincial Department of Education

Zitieren

APA

Chen, P., Li, L., Li, H., Wu, J., Dong, W., & Shi, G. (2023). Dynamic Expert-Knowledge Ensemble for Generalizable Video Quality Assessment. IEEE Transactions on Circuits and Systems for Video Technology, 33(6), 2577-2589. https://doi.org/10.1109/tcsvt.2022.3225552

Vancouver

Chen P, Li L, Li H, Wu J, Dong W, Shi G. Dynamic Expert-Knowledge Ensemble for Generalizable Video Quality Assessment. IEEE Transactions on Circuits and Systems for Video Technology. 2023;33(6):2577-2589. doi:10.1109/tcsvt.2022.3225552

BibTeX
@article{Chen2023,
  author = {Chen, Pengfei and Li, Leida and Li, Haoliang and Wu, Jinjian and Dong, Weisheng and Shi, Guangming},
  title = {Dynamic Expert-Knowledge Ensemble for Generalizable Video Quality Assessment},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2023},
  volume = {33},
  number = {6},
  pages = {2577--2589},
  doi = {10.1109/tcsvt.2022.3225552}
}
Kostenlos starten →