EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Human heuristics for AI-generated language are flawed

Maurice Jakesch iD, Jeffrey T Hancock iD, Mor Naaman iD

Proceedings of the National Academy of Sciences · 14.03.2023 · 120 (11)

DOI: 10.1073/pnas.2208839120 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 07.03.2023. Verfasst von Maurice Jakesch und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Science, Cornell University, Ithaca, NY 14850. Hauptthemen laut MEDLINE: Heuristics, Language. Die Arbeit wurde bisher 337-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Science Foundation (NSF).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Human communication is increasingly intermixed with language generated by AI. Across chat, email, and social media, AI systems suggest words, complete sentences, or produce entire conversations. AI-generated language is often not identified as such but presented as language written by humans, raising concerns about novel forms of deception and manipulation. Here, we study how humans discern whether verbal self-presentations, one of the most personal and consequential forms of language, were generated by AI. In six experiments, participants (N = 4,600) were unable to detect self-presentations generated by state-of-the-art AI language models in professional, hospitality, and dating contexts. A computational analysis of language features shows that human judgments of AI-generated language are hindered by intuitive but flawed heuristics such as associating first-person pronouns, use of contractions, or family topics with human-written language. We experimentally demonstrate that these heuristics make human judgment of AI-generated language predictable and manipulable, allowing AI systems to produce text perceived as “more human than human.” We discuss solutions, such as AI accents, to reduce the deceptive potential of language generated by AI, limiting the subversion of human intuition.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

HeuristicsLanguageHumansCommunicationCholine O-AcetyltransferaseArtificial Intelligence

Stichwörter der Autor:innen

cognitive heuristicshuman–AI interactionlanguage generationrisks of AI

Substanzen

Choline O-Acetyltransferase

Autor:innen und Institutionen

  • Department of Information Science, Cornell University, Ithaca, NY 14850.
  • Jacobs Institute, Cornell Tech, New York, NY 10044.
  • Department of Communication, Stanford University, Stanford, CA 94305.

ORCID-Profile: Maurice Jakesch, Jeffrey T Hancock, Mor Naaman

Förderung

  • National Science Foundation (NSF)

Zitieren

APA

Jakesch, M., Hancock, J. T., & Naaman, M. (2023). Human heuristics for AI-generated language are flawed. Proceedings of the National Academy of Sciences, 120(11). https://doi.org/10.1073/pnas.2208839120

Vancouver

Jakesch M, Hancock JT, Naaman M. Human heuristics for AI-generated language are flawed. Proceedings of the National Academy of Sciences. 2023;120(11). doi:10.1073/pnas.2208839120

BibTeX
@article{Jakesch2023,
  author = {Jakesch, Maurice and Hancock, Jeffrey T and Naaman, Mor},
  title = {Human heuristics for AI-generated language are flawed},
  journal = {Proceedings of the National Academy of Sciences},
  year = {2023},
  volume = {120},
  number = {11},
  doi = {10.1073/pnas.2208839120}
}
Kostenlos starten →