EUVIMEDEUVIMED entdecken
Crossref

Exploring CLIP for Assessing the Look and Feel of Images

Jianyi Wang, Kelvin C.K. Chan, Chen Change Loy

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (2) · 2555-2563

DOI: 10.1609/aaai.v37i2.25353 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Jianyi Wang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 849-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Measuring the perception of visual content is a long-standing problem in computer vision. Many mathematical models have been developed to evaluate the look or quality of an image. Despite the effectiveness of such tools in quantifying degradations such as noise and blurriness levels, such quantification is loosely coupled with human language. When it comes to more abstract perception about the feel of visual content, existing methods can only rely on supervised models that are explicitly trained with labeled data collected via laborious user study. In this paper, we go beyond the conventional paradigms by exploring the rich visual language prior encapsulated in Contrastive Language-Image Pre-training (CLIP) models for assessing both the quality perception (look) and abstract perception (feel) of images without explicit task-specific training. In particular, we discuss effective prompt designs and show an effective prompt pairing strategy to harness the prior. We also provide extensive experiments on controlled datasets and Image Quality Assessment (IQA) benchmarks. Our results show that CLIP captures meaningful priors that generalize well to different perceptual assessments.

Zitieren

APA

Wang, J., Chan, K. C., & Loy, C. C. (2023). Exploring CLIP for Assessing the Look and Feel of Images. Proceedings of the AAAI Conference on Artificial Intelligence, 37(2), 2555-2563. https://doi.org/10.1609/aaai.v37i2.25353

Vancouver

Wang J, Chan KC, Loy CC. Exploring CLIP for Assessing the Look and Feel of Images. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(2):2555-2563. doi:10.1609/aaai.v37i2.25353

BibTeX
@article{Wang2023,
  author = {Wang, Jianyi and Chan, Kelvin C.K. and Loy, Chen Change},
  title = {Exploring CLIP for Assessing the Look and Feel of Images},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {2},
  pages = {2555--2563},
  doi = {10.1609/aaai.v37i2.25353}
}
Kostenlos starten →