EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Distinguishing Human- and AI-Generated Image Descriptions Using CLIP Similarity and Transformer-Based Classification

Daniela Onita, Matei-Vasile Căpîlnaș, Adriana Baciu (Birlutiu)

Mathematics · 09.10.2025 · 13 (19) · 3228

DOI: 10.3390/math13193228 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 09.10.2025. Verfasst von Daniela Onita und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advances in vision-language models such as BLIP-2 have made AI-generated image descriptions increasingly fluent and difficult to distinguish from human-authored texts. This paper investigates whether such differences can still be reliably detected by introducing a novel bilingual dataset of English and Romanian captions. The English subset was derived from the T4SA dataset, while AI-generated captions were produced with BLIP-2 and translated into Romanian using MarianMT; human-written Romanian captions were collected via manual annotation. We analyze the problem from two perspectives: (i) semantic alignment, using CLIP similarity, and (ii) supervised classification with both traditional and transformer-based models. Our results show that BERT achieves over 95% cross-validation accuracy (F1 = 0.95, ROC AUC = 0.99) in distinguishing AI from human texts, while simpler classifiers such as Logistic Regression also reach competitive scores (F1 ≈ 0.88). Beyond classification, semantic and linguistic analyses reveal systematic cross-lingual differences: English captions are significantly longer and more verbose, whereas Romanian texts—often more concise—exhibit higher alignment with visual content. Romanian was chosen as a representative low-resource language, where studying such differences provides insights into multilingual AI detection and challenges in vision-language modeling. These findings emphasize the novelty of our contribution: a publicly available bilingual dataset and the first systematic comparison of human vs. AI-generated captions in both high- and low-resource languages.

Zitieren

APA

Onita, D., Căpîlnaș, M., & (Birlutiu), A. B. (2025). Distinguishing Human- and AI-Generated Image Descriptions Using CLIP Similarity and Transformer-Based Classification. Mathematics, 13(19), 3228. https://doi.org/10.3390/math13193228

Vancouver

Onita D, Căpîlnaș M, (Birlutiu) AB. Distinguishing Human- and AI-Generated Image Descriptions Using CLIP Similarity and Transformer-Based Classification. Mathematics. 2025;13(19):3228. doi:10.3390/math13193228

BibTeX
@article{Onita2025,
  author = {Onita, Daniela and Căpîlnaș, Matei-Vasile and (Birlutiu), Adriana Baciu},
  title = {Distinguishing Human- and AI-Generated Image Descriptions Using CLIP Similarity and Transformer-Based Classification},
  journal = {Mathematics},
  year = {2025},
  volume = {13},
  number = {19},
  pages = {3228},
  doi = {10.3390/math13193228}
}
Kostenlos starten →