A Turing test of whether AI chatbots are behaviorally similar to humans
Proceedings of the National Academy of Sciences · 27.02.2024 · 121 (9)
DOI: 10.1073/pnas.2313925121 ↗Kurz gefasst
Evaluationsstudie in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 22.02.2024. Verfasst von Qiaozhu Mei und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Information, University of Michigan, Ann Arbor, MI 48109. Hauptthemen laut MEDLINE: Artificial Intelligence, Behavior. Die Arbeit wurde bisher 232-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
We administer a Turing test to AI chatbots. We examine how chatbots behave in a suite of classic behavioral games that are designed to elicit characteristics such as trust, fairness, risk-aversion, cooperation, etc., as well as how they respond to a traditional Big-5 psychological survey that measures personality traits. ChatGPT-4 exhibits behavioral and personality traits that are statistically indistinguishable from a random human from tens of thousands of human subjects from more than 50 countries. Chatbots also modify their behavior based on previous experience and contexts “as if” they were learning from the interactions and change their behavior in response to different framings of the same strategic situation. Their behaviors are often distinct from average and modal human behaviors, in which case they tend to behave on the more altruistic and cooperative end of the distribution. We estimate that they act as if they are maximizing an average of their own and partner’s payoffs.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Information, University of Michigan, Ann Arbor, MI 48109.
- MobLab, Pasadena, CA 91107.
- Department of Economics, Stanford University, Stanford, CA 94305.
- External Faculty, Santa Fe Institute, Santa Fe, NM 87501.
ORCID-Profile: Matthew O Jackson
Zitieren
APA
Mei, Q., Xie, Y., Yuan, W., & Jackson, M. O. (2024). A Turing test of whether AI chatbots are behaviorally similar to humans. Proceedings of the National Academy of Sciences, 121(9). https://doi.org/10.1073/pnas.2313925121
Vancouver
Mei Q, Xie Y, Yuan W, Jackson MO. A Turing test of whether AI chatbots are behaviorally similar to humans. Proceedings of the National Academy of Sciences. 2024;121(9). doi:10.1073/pnas.2313925121
BibTeX
@article{Mei2024,
author = {Mei, Qiaozhu and Xie, Yutong and Yuan, Walter and Jackson, Matthew O},
title = {A Turing test of whether AI chatbots are behaviorally similar to humans},
journal = {Proceedings of the National Academy of Sciences},
year = {2024},
volume = {121},
number = {9},
doi = {10.1073/pnas.2313925121}
}
EUVIMED