Deep Active Learning with Contaminated Tags for Image Aesthetics Assessment
IEEE Transactions on Image Processing · 2024 · 1-1
DOI: 10.1109/tip.2018.2828326 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Zhenguang Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 32-mal zitiert (Crossref).
Abstract (Originalsprache)
Image aesthetic quality assessment has becoming an indispensable technique that facilitates a variety of image applications, e.g., photo retargeting and non-realistic rendering. Conventional approaches suffer from the following limitations: 1) the inefficiency of semantically describing images due to the inherent tag noise and incompletion, 2) the difficulty of accurately reflecting how humans actively perceive various regions inside each image, and 3) the challenge of incorporating the aesthetic experiences of multiple users. To solve these problems, we propose a novel semi-supervised deep active learning (SDAL) algorithm, which discovers how humans perceive semantically important regions from a large quantity of images partially assigned with contaminated tags. More specifically, as humans usually attend to the foreground objects before understanding them, we extract a succinct set of BING (binarized normed gradients) [60]-based object patches from each image. To simulate human visual perception, we propose SDAL which hierarchically learns human gaze shifting path (GSP) by sequentially linking semantically important object patches from each scenery. Noticeably, SDLA unifies the semantically important regions discovery and deep GSP feature learning into a principled framework, wherein only a small proportion of tagged images are adopted. Moreover, based on the sparsity penalty, SDLA can optimally abandon the noisy or redundant low-level image features. Finally, by leveraging the deeply-learned GSP features, a probabilistic model is developed for image aesthetics assessment, where the experience of multiple professional photographers can be encoded. Besides, auxiliary quality-related features can be conveniently integrated into our probabilistic model. Comprehensive experiments on a series of benchmark image sets have demonstrated the superiority of our method. As a byproduct, eye tracking experiments have shown that GSPs generated by our SDAL are about 93% consistent with real human gaze shifting paths.
Zitieren
APA
Liu, Z., Wang, Z., Yao, Y., Zhang, L., & Shao, L. (2024). Deep Active Learning with Contaminated Tags for Image Aesthetics Assessment. IEEE Transactions on Image Processing, 1-1. https://doi.org/10.1109/tip.2018.2828326
Vancouver
Liu Z, Wang Z, Yao Y, Zhang L, Shao L. Deep Active Learning with Contaminated Tags for Image Aesthetics Assessment. IEEE Transactions on Image Processing. 2024:1-1. doi:10.1109/tip.2018.2828326
BibTeX
@article{Liu2024,
author = {Liu, Zhenguang and Wang, Zepeng and Yao, Yiyang and Zhang, Luming and Shao, Ling},
title = {Deep Active Learning with Contaminated Tags for Image Aesthetics Assessment},
journal = {IEEE Transactions on Image Processing},
year = {2024},
pages = {1--1},
doi = {10.1109/tip.2018.2828326}
}
EUVIMED