EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle

Eva Huber iD, Sebastian Sauppe iD, Arrate Isasi-Isasmendi iD, Ina Bornkessel-Schlesewsky iD, Paola Merlo iD, Balthasar Bickel iD

Neurobiology of Language · 01.04.2024 · 5 (1) · 167-200

DOI: 10.1162/nol_a_00121 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neurobiology of Language, online erschienen am 01.04.2024. Verfasst von Eva Huber und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Comparative Language Science, University of Zurich, Zurich, Switzerland. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 143 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Center of Competence Evolving Language, Swiss National Science Foundation Grant, Centre of Excellence in Future Low-Energy Electronics Technologies, Australian Research Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Language models based on artificial neural networks increasingly capture key aspects of how humans process sentences. Most notably, model-based surprisals predict event-related potentials such as N400 amplitudes during parsing. Assuming that these models represent realistic estimates of human linguistic experience, their success in modeling language processing raises the possibility that the human processing system relies on no other principles than the general architecture of language models and on sufficient linguistic input. Here, we test this hypothesis on N400 effects observed during the processing of verb-final sentences in German, Basque, and Hindi. By stacking Bayesian generalised additive models, we show that, in each language, N400 amplitudes and topographies in the region of the verb are best predicted when model-based surprisals are complemented by an Agent Preference principle that transiently interprets initial role-ambiguous noun phrases as agents, leading to reanalysis when this interpretation fails. Our findings demonstrate the need for this principle independently of usage frequencies and structural differences between languages. The principle has an unequal force, however. Compared to surprisal, its effect is weakest in German, stronger in Hindi, and still stronger in Basque. This gradient is correlated with the extent to which grammars allow unmarked NPs to be patients, a structural feature that boosts reanalysis effects. We conclude that language models gain more neurobiological plausibility by incorporating an Agent Preference. Conversely, theories of human processing profit from incorporating surprisal estimates in addition to principles like the Agent Preference, which arguably have distinct evolutionary roots.

Schlagwörter

Stichwörter der Autor:innen

ERPartificial neural networkscomputational modelingevent cognitionlarge language models (LLMs)sentence processingsurprisal

Autor:innen und Institutionen

  • Department of Comparative Language Science, University of Zurich, Zurich, Switzerland.
  • Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Zurich, Switzerland.
  • Department of Psychology, University of Zurich, Zurich, Switzerland.
  • Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia, Adelaide, Australia.
  • Department of Linguistics, University of Geneva, Geneva, Switzerland.
  • University Center for Computer Science, University of Geneva, Geneva, Switzerland.

ORCID-Profile: Eva Huber, Sebastian Sauppe, Arrate Isasi-Isasmendi, Ina Bornkessel-Schlesewsky, Paola Merlo, Balthasar Bickel

Förderung

  • National Center of Competence Evolving Language
  • Swiss National Science Foundation Grant
  • Centre of Excellence in Future Low-Energy Electronics Technologies, Australian Research Council

Zitieren

APA

Huber, E., Sauppe, S., Isasi-Isasmendi, A., Bornkessel-Schlesewsky, I., Merlo, P., & Bickel, B. (2024). Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle. Neurobiology of Language, 5(1), 167-200. https://doi.org/10.1162/nol_a_00121

Vancouver

Huber E, Sauppe S, Isasi-Isasmendi A, Bornkessel-Schlesewsky I, Merlo P, Bickel B. Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle. Neurobiology of Language. 2024;5(1):167-200. doi:10.1162/nol_a_00121

BibTeX
@article{Huber2024,
  author = {Huber, Eva and Sauppe, Sebastian and Isasi-Isasmendi, Arrate and Bornkessel-Schlesewsky, Ina and Merlo, Paola and Bickel, Balthasar},
  title = {Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle},
  journal = {Neurobiology of Language},
  year = {2024},
  volume = {5},
  number = {1},
  pages = {167--200},
  doi = {10.1162/nol_a_00121}
}
Kostenlos starten →