EUVIMEDEUVIMED entdecken
Systematische Übersicht

A Systematic Review on the Evaluation of Large Language Models in Theory of Mind Tasks

Karahan Sarıtaş, Kıvanç Tezören, Yavuz Durmazkeser

arXiv (Cornell University) · 12.02.2025

DOI: 10.48550/arxiv.2502.08796 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift arXiv (Cornell University), erschienen am 12.02.2025. Verfasst von Karahan Sarıtaş und 2 weiteren Autor:innen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, evaluating the Theory of Mind (ToM) capabilities of large language models (LLMs) has received significant attention within the research community. As the field rapidly evolves, navigating the diverse approaches and methodologies has become increasingly complex. This systematic review synthesizes current efforts to assess LLMs' ability to perform ToM tasks, an essential aspect of human cognition involving the attribution of mental states to oneself and others. Despite notable advancements, the proficiency of LLMs in ToM remains a contentious issue. By categorizing benchmarks and tasks through a taxonomy rooted in cognitive science, this review critically examines evaluation techniques, prompting strategies, and the inherent limitations of LLMs in replicating human-like mental state reasoning. A recurring theme in the literature reveals that while LLMs demonstrate emerging competence in ToM tasks, significant gaps persist in their emulation of human cognitive abilities.

Schlagwörter

theory of mindlarge language modelsLLM evaluationmental state reasoningmental state attributionprompting strategiescognitive science

Zitieren

APA

Sarıtaş, K., Tezören, K., & Durmazkeser, Y. (2025). A Systematic Review on the Evaluation of Large Language Models in Theory of Mind Tasks. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.08796

Vancouver

Sarıtaş K, Tezören K, Durmazkeser Y. A Systematic Review on the Evaluation of Large Language Models in Theory of Mind Tasks. arXiv (Cornell University). 2025. doi:10.48550/arxiv.2502.08796

BibTeX
@article{Sarta2025,
  author = {Sarıtaş, Karahan and Tezören, Kıvanç and Durmazkeser, Yavuz},
  title = {A Systematic Review on the Evaluation of Large Language Models in Theory of Mind Tasks},
  journal = {arXiv (Cornell University)},
  year = {2025},
  doi = {10.48550/arxiv.2502.08796}
}
Kostenlos starten →