EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Core Vocabulary Reveals Differences Between Human Word Prediction and Large Language Models

Andrew Wang, Simon De Deyne, Meredith McKague, Andrew Perfors

Collabra: Psychology · 27.04.2026 · 12 (1)

DOI: 10.1525/collabra.160142 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Collabra: Psychology, online erschienen am 27.04.2026. Verfasst von Andrew Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Melbourne School of Psychological Sciences.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The question of which words are the most central or important to a language has been explored in various ways. In this study, we propose definitions of core vocabulary that are based on how language is learned, represented, and processed from psychological perspectives, and test these on a word prediction task. We aim to (1) compare core vocabulary based on word frequency in natural language, word association network centrality, and age-of-acquisition in terms of how well they are guessed in word prediction contexts, and (2) investigate the extent to which word prediction in large language models aligns with humans, and if there are systematic differences between them, whether these can be captured by core vocabulary measures. Across two experiments, 867 participants completed a task which involved guessing target words that were missing from sentence contexts. Word frequency-based core words were easier to guess overall, but when the predictability of words was taken into account, word association- and acquisition-based core words were easier to predict, indicating that people have a preference for simpler or more basic words over and above distributional predictability. Additionally, we show that there are systematic deviations between the predictions of a large language model (BERT) and humans, and that these are best captured by word association-based coreness. The findings suggest that distributional relationships between words in text is not all there is to human word prediction, but that people may also rely on factors like communicative usefulness and multimodal or extralinguistic information. Implications for core vocabulary, word prediction, and the relationship between large language models and human cognition are discussed.

Förderung

  • Melbourne School of Psychological Sciences

Zitieren

APA

Wang, A., Deyne, S. D., McKague, M., & Perfors, A. (2026). Core Vocabulary Reveals Differences Between Human Word Prediction and Large Language Models. Collabra: Psychology, 12(1). https://doi.org/10.1525/collabra.160142

Vancouver

Wang A, Deyne SD, McKague M, Perfors A. Core Vocabulary Reveals Differences Between Human Word Prediction and Large Language Models. Collabra: Psychology. 2026;12(1). doi:10.1525/collabra.160142

BibTeX
@article{Wang2026,
  author = {Wang, Andrew and Deyne, Simon De and McKague, Meredith and Perfors, Andrew},
  title = {Core Vocabulary Reveals Differences Between Human Word Prediction and Large Language Models},
  journal = {Collabra: Psychology},
  year = {2026},
  volume = {12},
  number = {1},
  doi = {10.1525/collabra.160142}
}
Kostenlos starten →