EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multiple Image Distortion DNN Modeling Individual Subject Quality Assessment

Lohic Fotio Tiotsop, Antonio Servetti, Peter Pocta, Glenn Van Wallendael, Marcus Barkowsky, Enrico Masala

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2024 · 20 (8) · 1-27

DOI: 10.1145/3664198 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 29.06.2024. Verfasst von Lohic Fotio Tiotsop und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: PIC4SeR.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A recent research direction is focused on training Deep Neural Networks (DNNs) to replicate individual subject assessments of media quality. These DNNs are referred to as Artificial Intelligence-based Observers (AIOs). An AIO is designed to simulate, in real-time, the quality ratings of a specific individual, enabling an automatic quality assessment that accounts for subjects characteristics and preferences. Training AIOs is a promising but challenging research area due to the greater noise in individual raw opinion scores compared to the Mean Opinion Score. Effective learning from noisy labels necessitates the training of complex models on large-scale datasets. Unfortunately, this is challenging for AIOs as the media quality assessment community lacks extensive datasets that include individual opinion scores. To address the complexity of the task, we first created a dataset comprising two million samples, with synthetic labels derived from human annotation. We then trained a customized network for image quality assessment, named Multi-Distortion ResNet50 (MDResNet50), on this dataset. The weights of the MDResNet50 were subsequently utilized to initialize the learning process of each AIO, thereby avoiding the need to train a complex model from scratch on a small-scale dataset with raw individual opinion scores. Computational experiments show that our approach significantly advances the state-of-the-art in the AIO research. In particular: (i) we demonstrate through a simulation the ability of AIOs to mimic two well-known behavioral characteristics of a subject, i.e., bias and inconsistency, when scoring the media quality; (ii) we train and release DNN-based AIOs that, compared to the state-of-the-art, exhibit a higher performance with a statistical significance in assessing multiple image distortions; (iii) we train AIOs that more accurately mimic the sensitivity of real subjects to noise and color saturation and also better predict the opinion score distribution compared to the state-of-the-art AIOs.

Förderung

  • PIC4SeR

Zitieren

APA

Tiotsop, L. F., Servetti, A., Pocta, P., Wallendael, G. V., Barkowsky, M., & Masala, E. (2024). Multiple Image Distortion DNN Modeling Individual Subject Quality Assessment. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(8), 1-27. https://doi.org/10.1145/3664198

Vancouver

Tiotsop LF, Servetti A, Pocta P, Wallendael GV, Barkowsky M, Masala E. Multiple Image Distortion DNN Modeling Individual Subject Quality Assessment. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(8):1-27. doi:10.1145/3664198

BibTeX
@article{Tiotsop2024,
  author = {Tiotsop, Lohic Fotio and Servetti, Antonio and Pocta, Peter and Wallendael, Glenn Van and Barkowsky, Marcus and Masala, Enrico},
  title = {Multiple Image Distortion DNN Modeling Individual Subject Quality Assessment},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2024},
  volume = {20},
  number = {8},
  pages = {1--27},
  doi = {10.1145/3664198}
}
Kostenlos starten →