Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle
Neurobiology of Language · 01.04.2024 · 5 (1) · 167-200
DOI: 10.1162/nol_a_00121 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neurobiology of Language, online erschienen am 01.04.2024. Verfasst von Eva Huber und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Comparative Language Science, University of Zurich, Zurich, Switzerland. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 143 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Center of Competence Evolving Language, Swiss National Science Foundation Grant, Centre of Excellence in Future Low-Energy Electronics Technologies, Australian Research Council.
Abstract (Originalsprache)
Language models based on artificial neural networks increasingly capture key aspects of how humans process sentences. Most notably, model-based surprisals predict event-related potentials such as N400 amplitudes during parsing. Assuming that these models represent realistic estimates of human linguistic experience, their success in modeling language processing raises the possibility that the human processing system relies on no other principles than the general architecture of language models and on sufficient linguistic input. Here, we test this hypothesis on N400 effects observed during the processing of verb-final sentences in German, Basque, and Hindi. By stacking Bayesian generalised additive models, we show that, in each language, N400 amplitudes and topographies in the region of the verb are best predicted when model-based surprisals are complemented by an Agent Preference principle that transiently interprets initial role-ambiguous noun phrases as agents, leading to reanalysis when this interpretation fails. Our findings demonstrate the need for this principle independently of usage frequencies and structural differences between languages. The principle has an unequal force, however. Compared to surprisal, its effect is weakest in German, stronger in Hindi, and still stronger in Basque. This gradient is correlated with the extent to which grammars allow unmarked NPs to be patients, a structural feature that boosts reanalysis effects. We conclude that language models gain more neurobiological plausibility by incorporating an Agent Preference. Conversely, theories of human processing profit from incorporating surprisal estimates in addition to principles like the Agent Preference, which arguably have distinct evolutionary roots.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Comparative Language Science, University of Zurich, Zurich, Switzerland.
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Zurich, Switzerland.
- Department of Psychology, University of Zurich, Zurich, Switzerland.
- Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia, Adelaide, Australia.
- Department of Linguistics, University of Geneva, Geneva, Switzerland.
- University Center for Computer Science, University of Geneva, Geneva, Switzerland.
ORCID-Profile: Eva Huber, Sebastian Sauppe, Arrate Isasi-Isasmendi, Ina Bornkessel-Schlesewsky, Paola Merlo, Balthasar Bickel
Förderung
- National Center of Competence Evolving Language
- Swiss National Science Foundation Grant
- Centre of Excellence in Future Low-Energy Electronics Technologies, Australian Research Council
Zitieren
APA
Huber, E., Sauppe, S., Isasi-Isasmendi, A., Bornkessel-Schlesewsky, I., Merlo, P., & Bickel, B. (2024). Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle. Neurobiology of Language, 5(1), 167-200. https://doi.org/10.1162/nol_a_00121
Vancouver
Huber E, Sauppe S, Isasi-Isasmendi A, Bornkessel-Schlesewsky I, Merlo P, Bickel B. Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle. Neurobiology of Language. 2024;5(1):167-200. doi:10.1162/nol_a_00121
BibTeX
@article{Huber2024,
author = {Huber, Eva and Sauppe, Sebastian and Isasi-Isasmendi, Arrate and Bornkessel-Schlesewsky, Ina and Merlo, Paola and Bickel, Balthasar},
title = {Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle},
journal = {Neurobiology of Language},
year = {2024},
volume = {5},
number = {1},
pages = {167--200},
doi = {10.1162/nol_a_00121}
}
EUVIMED