EUVIMEDEUVIMED entdecken
Systematische Übersicht

Artificial Intelligence and the Illusion of Understanding: A Systematic Review of Theory of Mind and Large Language Models

Antonella Marchetti, Federico Manzi iD, Giuseppe Riva iD, Andrea Gaggioli, Davide Massaro

Cyberpsychology, Behavior, and Social Networking · 01.07.2025 · 28 (7) · 505-514

DOI: 10.1089/cyber.2024.0536 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift Cyberpsychology, Behavior, and Social Networking, online erschienen am 30.06.2025. Verfasst von Antonella Marchetti und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, Research Center on Theory of Mind and Social Competences in the Lifespan, Università Cattolica del Sacro Cuore, Milan, Ital…. Hauptthemen laut MEDLINE: Theory of Mind, Artificial Intelligence, Language, Comprehension. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 51 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The development of Large Language Models (LLMs) has sparked significant debate regarding their capacity for Theory of Mind (ToM)—the ability to attribute mental states to oneself and others. This systematic review examines the extent to which LLMs exhibit Artificial ToM (AToM) by evaluating their performance on ToM tasks and comparing it with human responses. While LLMs, particularly GPT-4, perform well on first-order false belief tasks, they struggle with more complex reasoning, such as second-order beliefs and recursive inferences, where humans consistently outperform them. Moreover, the review underscores the variability in ToM assessments, as many studies adapt classical tasks for LLMs, raising concerns about comparability with human ToM. Most evaluations remain constrained to text-based tasks, overlooking embodied and multimodal dimensions crucial to human social cognition. This review discusses the “illusion of understanding” in LLMs for two primary reasons: First, their lack of the developmental and cognitive mechanisms necessary for genuine ToM, and second, methodological biases in test designs that favor LLMs’ strengths, limiting direct comparisons with human performance. The findings highlight the need for more ecologically valid assessments and interdisciplinary research to better delineate the limitations and potential of AToM. This set of issues is highly relevant to psychology, as language is generally considered just one component in the broader development of human ToM, a perspective that contrasts with the dominant approach in AToM studies. This discrepancy raises critical questions about the extent to which human ToM and AToM are comparable.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Theory of MindArtificial IntelligenceLanguageComprehensionHumansSocial CognitionLarge Language Models

Stichwörter der Autor:innen

Artificial Intelligence (AI)Large Language Models (LLMs)Theory of Mind (ToM)social reasoning

Autor:innen und Institutionen

  • Department of Psychology, Research Center on Theory of Mind and Social Competences in the Lifespan, Università Cattolica del Sacro Cuore, Milan, Italy.
  • Humane Technology Laboratory, Università Cattolica del Sacro Cuore, Milan, Italy.
  • Department of Psychology, Research Center in Communication Psychology, Università Cattolica del Sacro Cuore, Milan, Italy.

ORCID-Profile: Federico Manzi, Giuseppe Riva

Zitieren

APA

Marchetti, A., Manzi, F., Riva, G., Gaggioli, A., & Massaro, D. (2025). Artificial Intelligence and the Illusion of Understanding: A Systematic Review of Theory of Mind and Large Language Models. Cyberpsychology, Behavior, and Social Networking, 28(7), 505-514. https://doi.org/10.1089/cyber.2024.0536

Vancouver

Marchetti A, Manzi F, Riva G, Gaggioli A, Massaro D. Artificial Intelligence and the Illusion of Understanding: A Systematic Review of Theory of Mind and Large Language Models. Cyberpsychology, Behavior, and Social Networking. 2025;28(7):505-514. doi:10.1089/cyber.2024.0536

BibTeX
@article{Marchetti2025,
  author = {Marchetti, Antonella and Manzi, Federico and Riva, Giuseppe and Gaggioli, Andrea and Massaro, Davide},
  title = {Artificial Intelligence and the Illusion of Understanding: A Systematic Review of Theory of Mind and Large Language Models},
  journal = {Cyberpsychology, Behavior, and Social Networking},
  year = {2025},
  volume = {28},
  number = {7},
  pages = {505--514},
  doi = {10.1089/cyber.2024.0536}
}
Kostenlos starten →