EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

(Ir)rationality and cognitive biases in large language models

Olivia Macmillan-Scott iD, Mirco Musolesi iD

Royal Society Open Science · 2024-06 · 11 (6)

DOI: 10.1098/rsos.240255 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Royal Society Open Science, online erschienen am 05.06.2024. Verfasst von Olivia Macmillan-Scott und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, University College London, London, UK. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Leverhulme Trust.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer this question by evaluating seven language models using tasks from the cognitive psychology literature. We find that, like humans, LLMs display irrationality in these tasks. However, the way this irrationality is displayed does not reflect that shown by humans. When incorrect answers are given by LLMs to these tasks, they are often incorrect in ways that differ from human-like biases. On top of this, the LLMs reveal an additional layer of irrationality in the significant inconsistency of the responses. Aside from the experimental results, this paper seeks to make a methodological contribution by showing how we can assess and compare different capabilities of these types of models, in this case with respect to rational reasoning.

Schlagwörter

Stichwörter der Autor:innen

cognitive biaslarge language modelsrationality

Autor:innen und Institutionen

  • Department of Computer Science, University College London, London, UK.
  • Department of Computer Science and Engineering, University of Bologna, Bologna, Italy.

ORCID-Profile: Olivia Macmillan-Scott, Mirco Musolesi

Förderung

  • Leverhulme Trust

Zitieren

APA

Macmillan-Scott, O., & Musolesi, M. (2024). (Ir)rationality and cognitive biases in large language models. Royal Society Open Science, 11(6). https://doi.org/10.1098/rsos.240255

Vancouver

Macmillan-Scott O, Musolesi M. (Ir)rationality and cognitive biases in large language models. Royal Society Open Science. 2024;11(6). doi:10.1098/rsos.240255

BibTeX
@article{MacmillanScott2024,
  author = {Macmillan-Scott, Olivia and Musolesi, Mirco},
  title = {(Ir)rationality and cognitive biases in large language models},
  journal = {Royal Society Open Science},
  year = {2024},
  volume = {11},
  number = {6},
  doi = {10.1098/rsos.240255}
}
Kostenlos starten →