EUVIMEDEUVIMED entdecken
Crossref

Entropy's Dilemma: Facilitatory and Inhibitory Effects of Information Entropy During Language Processing

Hossein Karimi iD, Jaden Zinn, Haomiao Li iD

Cognitive Science · 2026-05 · 50 (5)

DOI: 10.1111/cogs.70218 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cognitive Science, online erschienen am 13.05.2026. Verfasst von Hossein Karimi und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, California State University, Fullerton. Hauptthemen laut MEDLINE: Entropy, Language. Die Arbeit nennt 80 Literaturangaben. Gefördert von: National Science Foundation, Directorate for Social, Behavioral and Economic Sciences.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

During language processing, context usually prompts predictions over multiple words, not a single word. We examined how the distribution of multiple plausible words following a context, that is, conditional entropy , influences lexical processing. Greater conditional entropy simultaneously corresponds to activation of more semantic features, which should facilitate processing, and activation of more lexical competitors, which should inhibit processing. Participants ( N = 58) completed two experimental sessions 14–21 days apart. In session 1, they produced up to eight completions for sentence fragments ( N = 648), missing a final, target word (e.g., banana ) along with probability values for each response. In session 2, they read the same sentences, including the target word, while their eye movements were tracked. We computed conditional entropy at the trial level (i.e., for each participant, for each sentence). To tease apart the semantic feature activation and lexical competition components of conditional entropy, we calculated total semantic overlap ; the sum of semantic similarity values between target words and the responses produced during sentence completion (e.g., mango , orange , coconut , etc.). The remainder of conditional entropy would then capture lexical entropy corresponding to lexical competition. The results revealed that semantic overlap facilitated lexical processing, but lexical entropy inhibited it. A reanalysis of an independent self‐paced reading dataset ( N participants = 111, N items = 647) revealed the same pattern. These results suggest that conditional entropy should be decomposed to semantic activation and lexical competition, corresponding to facilitation and inhibition during language processing, respectively. Implications for predictive processing views of language processing and large language models are discussed.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EntropyLanguageHumansSemanticsReadingEye MovementsFemaleYoung AdultMaleAdultComprehension

Stichwörter der Autor:innen

Information entropyLanguage processingLexical competitionSemantic similarity

Autor:innen und Institutionen

  • Department of Psychology, California State University, Fullerton.
  • Department of Psychology, Mississippi State University.

ORCID-Profile: Hossein Karimi, Haomiao Li

Förderung

  • National Science Foundation
  • Directorate for Social, Behavioral and Economic Sciences

Zitieren

APA

Karimi, H., Zinn, J., & Li, H. (2026). Entropy's Dilemma: Facilitatory and Inhibitory Effects of Information Entropy During Language Processing. Cognitive Science, 50(5). https://doi.org/10.1111/cogs.70218

Vancouver

Karimi H, Zinn J, Li H. Entropy's Dilemma: Facilitatory and Inhibitory Effects of Information Entropy During Language Processing. Cognitive Science. 2026;50(5). doi:10.1111/cogs.70218

BibTeX
@article{Karimi2026,
  author = {Karimi, Hossein and Zinn, Jaden and Li, Haomiao},
  title = {Entropy's Dilemma: Facilitatory and Inhibitory Effects of Information Entropy During Language Processing},
  journal = {Cognitive Science},
  year = {2026},
  volume = {50},
  number = {5},
  doi = {10.1111/cogs.70218}
}
Kostenlos starten →