EUVIMEDEUVIMED entdecken
Crossref

Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysis

Caoyun Fan, Jindou Chen, Yaohui Jin, Hao He

Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (16) · 17960-17967

DOI: 10.1609/aaai.v38i16.29751 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Caoyun Fan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 44-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Game theory, as an analytical tool, is frequently utilized to analyze human behavior in social science research. With the high alignment between the behavior of Large Language Models (LLMs) and humans, a promising research direction is to employ LLMs as substitutes for humans in game experiments, enabling social science research. However, despite numerous empirical researches on the combination of LLMs and game theory, the capability boundaries of LLMs in game theory remain unclear. In this research, we endeavor to systematically analyze LLMs in the context of game theory. Specifically, rationality, as the fundamental principle of game theory, serves as the metric for evaluating players' behavior --- building a clear desire, refining belief about uncertainty, and taking optimal actions. Accordingly, we select three classical games (dictator game, Rock-Paper-Scissors, and ring-network game) to analyze to what extent LLMs can achieve rationality in these three aspects. The experimental results indicate that even the current state-of-the-art LLM (GPT-4) exhibits substantial disparities compared to humans in game theory. For instance, LLMs struggle to build desires based on uncommon preferences, fail to refine belief from many simple patterns, and may overlook or modify refined belief when taking actions. Therefore, we consider that introducing LLMs into game experiments in the field of social science should be approached with greater caution.

Zitieren

APA

Fan, C., Chen, J., Jin, Y., & He, H. (2024). Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysis. Proceedings of the AAAI Conference on Artificial Intelligence, 38(16), 17960-17967. https://doi.org/10.1609/aaai.v38i16.29751

Vancouver

Fan C, Chen J, Jin Y, He H. Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysis. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(16):17960-17967. doi:10.1609/aaai.v38i16.29751

BibTeX
@article{Fan2024,
  author = {Fan, Caoyun and Chen, Jindou and Jin, Yaohui and He, Hao},
  title = {Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysis},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2024},
  volume = {38},
  number = {16},
  pages = {17960--17967},
  doi = {10.1609/aaai.v38i16.29751}
}
Kostenlos starten →