Art through CLIP’s Eyes
Journal on Computing and Cultural Heritage · 30.06.2026 · 19 (2) · 1-33
DOI: 10.1145/3812546 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal on Computing and Cultural Heritage, online erschienen am 25.06.2026. Verfasst von Andrea Asperti und 2 weiteren Autor:innen. Die Arbeit nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Despite significant advances in text-based reasoning, the ability of multimodal models to perceive and interpret visual art remains poorly understood. This study explores how CLIP “sees” and understands artworks—focusing on European paintings from the Renaissance onward—by examining its capacity to recognize style, historical period, and cultural context. We evaluate both the strengths and limitations of CLIP’s visual perception, particularly its alignment with human judgments. Our analysis spans paintings created by both humans and AI, probing CLIP’s sensitivity to subtle yet meaningful differences between them, as well as its ability to detect characteristic artifacts and distortions introduced by generative models. The investigation draws on several recent datasets of AI-generated art, offering a critical assessment of their data acquisition methodologies, structure, and benchmarking potential. This work contributes to bridging computational perception and human artistic interpretation, offering new insights into the evolving role of AI in art analysis.
Zitieren
APA
Asperti, A., Dessì, L., & Wu, N. (2026). Art through CLIP’s Eyes. Journal on Computing and Cultural Heritage, 19(2), 1-33. https://doi.org/10.1145/3812546
Vancouver
Asperti A, Dessì L, Wu N. Art through CLIP’s Eyes. Journal on Computing and Cultural Heritage. 2026;19(2):1-33. doi:10.1145/3812546
BibTeX
@article{Asperti2026,
author = {Asperti, Andrea and Dessì, Leonardo and Wu, Nico},
title = {Art through CLIP’s Eyes},
journal = {Journal on Computing and Cultural Heritage},
year = {2026},
volume = {19},
number = {2},
pages = {1--33},
doi = {10.1145/3812546}
}
EUVIMED