The emergence of economic rationality of GPT
Proceedings of the National Academy of Sciences · 19.12.2023 · 120 (51)
DOI: 10.1073/pnas.2316205120 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 12.12.2023. Verfasst von Yiting Chen und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Economics, Lingnan University, Hong Kong, China HKG. Die Arbeit wurde bisher 162-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: MOST | NSFC | National Outstanding Youth Foundation of China, Tsinghua University (THU), Hong Kong University of Science and Technology (HKUST).
Abstract (Originalsprache)
As large language models (LLMs) like GPT become increasingly prevalent, it is essential that we assess their capabilities beyond language processing. This paper examines the economic rationality of GPT by instructing it to make budgetary decisions in four domains: risk, time, social, and food preferences. We measure economic rationality by assessing the consistency of GPT’s decisions with utility maximization in classic revealed preference theory. We find that GPT’s decisions are largely rational in each domain and demonstrate higher rationality score than those of human subjects in a parallel experiment and in the literature. Moreover, the estimated preference parameters of GPT are slightly different from human subjects and exhibit a lower degree of heterogeneity. We also find that the rationality scores are robust to the degree of randomness and demographic settings such as age and gender but are sensitive to contexts based on the language frames of the choice situations. These results suggest the potential of LLMs to make good decisions and the need to further understand their capabilities, limitations, and underlying mechanisms.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Economics, Lingnan University, Hong Kong, China HKG.
- Department of Economics, School of Economics and Management, National Center for Economic Research at Tsinghua University, Tsinghua University, Beijing 100084, China.
- Department of Economics, School of Economics and Management, Tsinghua University, Beijing 100084, China.
- Department of Economics, Hong Kong University of Science and Technology, Hong Kong, China HKG.
- Department of Economics, National University of Singapore, Singapore 117570, Singapore.
ORCID-Profile: Yiting Chen, You Shan, Songfa Zhong
Förderung
- MOST | NSFC | National Outstanding Youth Foundation of China
- Tsinghua University (THU)
- Hong Kong University of Science and Technology (HKUST)
Zitieren
APA
Chen, Y., Liu, T. X., Shan, Y., & Zhong, S. (2023). The emergence of economic rationality of GPT. Proceedings of the National Academy of Sciences, 120(51). https://doi.org/10.1073/pnas.2316205120
Vancouver
Chen Y, Liu TX, Shan Y, Zhong S. The emergence of economic rationality of GPT. Proceedings of the National Academy of Sciences. 2023;120(51). doi:10.1073/pnas.2316205120
BibTeX
@article{Chen2023,
author = {Chen, Yiting and Liu, Tracy Xiao and Shan, You and Zhong, Songfa},
title = {The emergence of economic rationality of GPT},
journal = {Proceedings of the National Academy of Sciences},
year = {2023},
volume = {120},
number = {51},
doi = {10.1073/pnas.2316205120}
}
EUVIMED