Distinguishing Human- and AI-Generated Image Descriptions Using CLIP Similarity and Transformer-Based Classification
Mathematics · 09.10.2025 · 13 (19) · 3228
DOI: 10.3390/math13193228 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 09.10.2025. Verfasst von Daniela Onita und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Recent advances in vision-language models such as BLIP-2 have made AI-generated image descriptions increasingly fluent and difficult to distinguish from human-authored texts. This paper investigates whether such differences can still be reliably detected by introducing a novel bilingual dataset of English and Romanian captions. The English subset was derived from the T4SA dataset, while AI-generated captions were produced with BLIP-2 and translated into Romanian using MarianMT; human-written Romanian captions were collected via manual annotation. We analyze the problem from two perspectives: (i) semantic alignment, using CLIP similarity, and (ii) supervised classification with both traditional and transformer-based models. Our results show that BERT achieves over 95% cross-validation accuracy (F1 = 0.95, ROC AUC = 0.99) in distinguishing AI from human texts, while simpler classifiers such as Logistic Regression also reach competitive scores (F1 ≈ 0.88). Beyond classification, semantic and linguistic analyses reveal systematic cross-lingual differences: English captions are significantly longer and more verbose, whereas Romanian texts—often more concise—exhibit higher alignment with visual content. Romanian was chosen as a representative low-resource language, where studying such differences provides insights into multilingual AI detection and challenges in vision-language modeling. These findings emphasize the novelty of our contribution: a publicly available bilingual dataset and the first systematic comparison of human vs. AI-generated captions in both high- and low-resource languages.
Zitieren
APA
Onita, D., Căpîlnaș, M., & (Birlutiu), A. B. (2025). Distinguishing Human- and AI-Generated Image Descriptions Using CLIP Similarity and Transformer-Based Classification. Mathematics, 13(19), 3228. https://doi.org/10.3390/math13193228
Vancouver
Onita D, Căpîlnaș M, (Birlutiu) AB. Distinguishing Human- and AI-Generated Image Descriptions Using CLIP Similarity and Transformer-Based Classification. Mathematics. 2025;13(19):3228. doi:10.3390/math13193228
BibTeX
@article{Onita2025,
author = {Onita, Daniela and Căpîlnaș, Matei-Vasile and (Birlutiu), Adriana Baciu},
title = {Distinguishing Human- and AI-Generated Image Descriptions Using CLIP Similarity and Transformer-Based Classification},
journal = {Mathematics},
year = {2025},
volume = {13},
number = {19},
pages = {3228},
doi = {10.3390/math13193228}
}
EUVIMED