EUVIMEDEUVIMED entdecken
Crossref

Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Model

Zhichao Zhang, Wei Sun, Li Xinyue, Jun Jia, Xiongkuo Min, Zicheng Zhang, Chunyi Li, Zijian Chen, Wang Puyi, Sun Fengyu, Jui Shangling, Guangtao Zhai

ACM Transactions on Multimedia Computing, Communications, and Applications · 30.09.2025 · 21 (9) · 1-24

DOI: 10.1145/3749844 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 11.09.2025. Verfasst von Zhichao Zhang und 11 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 100 Literaturangaben. Gefördert von: National Natural Science Foundation of China, STCSM.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, AI-driven video generation has gained significant attention due to great advancements in visual and language generative techniques. Consequently, there is a growing need for accurate Video Quality Assessment (VQA) metrics to evaluate the perceptual quality of AI-generated content (AIGC) videos and optimize video generation models. However, assessing the quality of AIGC videos remains a significant challenge because these videos often exhibit highly complex distortions, such as unnatural actions and irrational objects. To address this challenge, we systematically investigate the AIGC-VQA problem in this article, considering both subjective and objective quality assessment perspectives. For the subjective perspective, we construct the L arge-scale G enerated V ideo Q uality Assessment (LGVQ) dataset, consisting of \(2,\!808\) AIGC videos generated by six video generation models using 468 carefully curated text prompts. Unlike previous subjective VQA experiments, we evaluate the perceptual quality of AIGC videos from three critical dimensions: spatial quality, temporal quality, and text-video alignment, which hold utmost importance for current video generation techniques. For the objective perspective, we establish a benchmark for evaluating existing quality assessment metrics on the LGVQ dataset. Our findings show that current metrics perform poorly on this dataset, highlighting a gap in effective evaluation tools. To bridge this gap, we propose the U nify G enerated V ideo Q uality Assessment (UGVQ) model, designed to accurately evaluate the multi-dimensional quality of AIGC videos. The UGVQ model integrates the visual and motion features of videos with the textual features of their corresponding prompts, forming a unified quality-aware feature representation tailored to AIGC videos. Experimental results demonstrate that UGVQ achieves state-of-the-art performance on the LGVQ dataset across all three quality dimensions, validating its effectiveness as an accurate quality metric for AIGC videos. We hope that our benchmark can promote the development of AIGC-VQA studies. Both the LGVQ dataset and the UGVQ model are publicly available on https://github.com/zczhang-sjtu/UGVQ.git .

Förderung

  • National Natural Science Foundation of China
  • STCSM

Zitieren

APA

Zhang, Z., Sun, W., Xinyue, L., Jia, J., Min, X., Zhang, Z., Li, C., Chen, Z., Puyi, W., Fengyu, S., Shangling, J., & Zhai, G. (2025). Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Model. ACM Transactions on Multimedia Computing, Communications, and Applications, 21(9), 1-24. https://doi.org/10.1145/3749844

Vancouver

Zhang Z, Sun W, Xinyue L, Jia J, Min X, Zhang Z, et al. Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Model. ACM Transactions on Multimedia Computing, Communications, and Applications. 2025;21(9):1-24. doi:10.1145/3749844

BibTeX
@article{Zhang2025,
  author = {Zhang, Zhichao and Sun, Wei and Xinyue, Li and Jia, Jun and Min, Xiongkuo and Zhang, Zicheng and Li, Chunyi and Chen, Zijian and Puyi, Wang and Fengyu, Sun and Shangling, Jui and Zhai, Guangtao},
  title = {Benchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Model},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2025},
  volume = {21},
  number = {9},
  pages = {1--24},
  doi = {10.1145/3749844}
}
Kostenlos starten →