EUVIMEDEUVIMED entdecken
EvaluationsstudieOpen Access · CC BY-NC-ND 4.0

A Turing test of whether AI chatbots are behaviorally similar to humans

Qiaozhu Mei, Yutong Xie, Walter Yuan, Matthew O Jackson iD

Proceedings of the National Academy of Sciences · 27.02.2024 · 121 (9)

DOI: 10.1073/pnas.2313925121 ↗

Kurz gefasst

Evaluationsstudie in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 22.02.2024. Verfasst von Qiaozhu Mei und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Information, University of Michigan, Ann Arbor, MI 48109. Hauptthemen laut MEDLINE: Artificial Intelligence, Behavior. Die Arbeit wurde bisher 232-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We administer a Turing test to AI chatbots. We examine how chatbots behave in a suite of classic behavioral games that are designed to elicit characteristics such as trust, fairness, risk-aversion, cooperation, etc., as well as how they respond to a traditional Big-5 psychological survey that measures personality traits. ChatGPT-4 exhibits behavioral and personality traits that are statistically indistinguishable from a random human from tens of thousands of human subjects from more than 50 countries. Chatbots also modify their behavior based on previous experience and contexts “as if” they were learning from the interactions and change their behavior in response to different framings of the same strategic situation. Their behaviors are often distinct from average and modal human behaviors, in which case they tend to behave on the more altruistic and cooperative end of the distribution. We estimate that they act as if they are maximizing an average of their own and partner’s payoffs.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceBehaviorHumansAltruismTrust

Stichwörter der Autor:innen

AITuring testbehavioral gameschatbotpersonality

Autor:innen und Institutionen

  • School of Information, University of Michigan, Ann Arbor, MI 48109.
  • MobLab, Pasadena, CA 91107.
  • Department of Economics, Stanford University, Stanford, CA 94305.
  • External Faculty, Santa Fe Institute, Santa Fe, NM 87501.

ORCID-Profile: Matthew O Jackson

Zitieren

APA

Mei, Q., Xie, Y., Yuan, W., & Jackson, M. O. (2024). A Turing test of whether AI chatbots are behaviorally similar to humans. Proceedings of the National Academy of Sciences, 121(9). https://doi.org/10.1073/pnas.2313925121

Vancouver

Mei Q, Xie Y, Yuan W, Jackson MO. A Turing test of whether AI chatbots are behaviorally similar to humans. Proceedings of the National Academy of Sciences. 2024;121(9). doi:10.1073/pnas.2313925121

BibTeX
@article{Mei2024,
  author = {Mei, Qiaozhu and Xie, Yutong and Yuan, Walter and Jackson, Matthew O},
  title = {A Turing test of whether AI chatbots are behaviorally similar to humans},
  journal = {Proceedings of the National Academy of Sciences},
  year = {2024},
  volume = {121},
  number = {9},
  doi = {10.1073/pnas.2313925121}
}
Kostenlos starten →