Strong Prediction: Language Model Surprisal Explains Multiple N400 Effects
Neurobiology of Language · 01.04.2024 · 5 (1) · 107-135
DOI: 10.1162/nol_a_00105 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neurobiology of Language, online erschienen am 01.04.2024. Verfasst von James A Michaelov und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Cognitive Science, University of California, San Diego, La Jolla, CA, USA. Die Arbeit wurde bisher 73-mal zitiert (Crossref) und nennt 157 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Center for Academic Research and Training in Anthropogeny.
Abstract (Originalsprache)
Theoretical accounts of the N400 are divided as to whether the amplitude of the N400 response to a stimulus reflects the extent to which the stimulus was predicted, the extent to which the stimulus is semantically similar to its preceding context, or both. We use state-of-the-art machine learning tools to investigate which of these three accounts is best supported by the evidence. GPT-3, a neural language model trained to compute the conditional probability of any word based on the words that precede it, was used to operationalize contextual predictability. In particular, we used an information-theoretic construct known as surprisal (the negative logarithm of the conditional probability). Contextual semantic similarity was operationalized by using two high-quality co-occurrence-derived vector-based meaning representations for words: GloVe and fastText. The cosine between the vector representation of the sentence frame and final word was used to derive contextual cosine similarity estimates. A series of regression models were constructed, where these variables, along with cloze probability and plausibility ratings, were used to predict single trial N400 amplitudes recorded from healthy adults as they read sentences whose final word varied in its predictability, plausibility, and semantic relationship to the likeliest sentence completion. Statistical model comparison indicated GPT-3 surprisal provided the best account of N400 amplitude and suggested that apparently disparate N400 effects of expectancy, plausibility, and contextual semantic similarity can be reduced to variation in the predictability of words. The results are argued to support predictive coding in the human language network.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Cognitive Science, University of California, San Diego, La Jolla, CA, USA.
- Department of Psychology, Binghamton University, State University of New York, Binghamton, NY, USA.
ORCID-Profile: James A Michaelov, Megan D Bardolph, Cyma K Van Petten, Benjamin K Bergen, Seana Coulson
Förderung
- Center for Academic Research and Training in Anthropogeny
Zitieren
APA
Michaelov, J. A., Bardolph, M. D., Van Petten, C. K., Bergen, B. K., & Coulson, S. (2024). Strong Prediction: Language Model Surprisal Explains Multiple N400 Effects. Neurobiology of Language, 5(1), 107-135. https://doi.org/10.1162/nol_a_00105
Vancouver
Michaelov JA, Bardolph MD, Van Petten CK, Bergen BK, Coulson S. Strong Prediction: Language Model Surprisal Explains Multiple N400 Effects. Neurobiology of Language. 2024;5(1):107-135. doi:10.1162/nol_a_00105
BibTeX
@article{Michaelov2024,
author = {Michaelov, James A and Bardolph, Megan D and Van Petten, Cyma K and Bergen, Benjamin K and Coulson, Seana},
title = {Strong Prediction: Language Model Surprisal Explains Multiple N400 Effects},
journal = {Neurobiology of Language},
year = {2024},
volume = {5},
number = {1},
pages = {107--135},
doi = {10.1162/nol_a_00105}
}
EUVIMED