EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-SA 4.0

Characteristics and Prevalence of Fake Social Media Profiles with AI-generated Faces

Kaicheng Yang, Danishjeet Singh, Filippo Menczer

Journal of Online Trust and Safety · 18.09.2024 · 2 (4)

DOI: 10.54501/jots.v2i4.197 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Online Trust and Safety, online erschienen am 18.09.2024. Verfasst von Kaicheng Yang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advancements in generative artificial intelligence (AI) have raised concerns about its potential to create convincing fake social media accounts, but empirical evidence is lacking. In this paper, we present a systematic analysis of Twitter (X) accounts using human faces generated by Generative Adversarial Networks (GANs) for their profile pictures. We present a dataset of 1,420 such accounts and show that they are used to spread scams, disseminate spam, and amplify coordinated messages, among other inauthentic activities. Leveraging a feature of GAN-generated faces—consistent eye placement—and supplementing it with human annotation, we devise an effective method for identifying GAN-generated profiles in the wild. Applying this method to a random sample of active Twitter users, we estimate a lower bound for the prevalence of profiles using GAN-generated faces between 0.021% and 0.044%—around 10,000 daily active accounts. These findings underscore the emerging threats posed by multimodal generative AI. We release the source code of our detection method and the data we collect to facilitate further investigation. Additionally, we provide practical heuristics to assist social media users in recognizing such accounts.

Zitieren

APA

Yang, K., Singh, D., & Menczer, F. (2024). Characteristics and Prevalence of Fake Social Media Profiles with AI-generated Faces. Journal of Online Trust and Safety, 2(4). https://doi.org/10.54501/jots.v2i4.197

Vancouver

Yang K, Singh D, Menczer F. Characteristics and Prevalence of Fake Social Media Profiles with AI-generated Faces. Journal of Online Trust and Safety. 2024;2(4). doi:10.54501/jots.v2i4.197

BibTeX
@article{Yang2024,
  author = {Yang, Kaicheng and Singh, Danishjeet and Menczer, Filippo},
  title = {Characteristics and Prevalence of Fake Social Media Profiles with AI-generated Faces},
  journal = {Journal of Online Trust and Safety},
  year = {2024},
  volume = {2},
  number = {4},
  doi = {10.54501/jots.v2i4.197}
}
Kostenlos starten →