EUVIMEDScopri EUVIMED
Open access · CC BY 4.0

Computational Sentence‐Level Metrics of Reading Speed and Its Ramifications for Sentence Comprehension

Kun Sun, Rong Wang

Cognitive Science · 2025

DOI: 10.1111/cogs.70092 ↗

At a glance

Journal article in Cognitive Science, 2025. Written by Kun Sun and 1 co-authors. Institution: School of Foreign Languages, Tongji University. Major MEDLINE topics: Reading, Comprehension, Psycholinguistics, Language. Cited 1 times so far (Crossref); 89 references. The full text is freely available (open access, CC BY 4.0). Funded by: The Deutsche Forschungsgemeinschaft (DFG).

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

The majority of research in computational psycholinguistics on sentence processing has focused on word‐by‐word incremental processing within sentences, rather than holistic sentence‐level representations. This study introduces two novel computational approaches for quantifying sentence‐level processing: sentence surprisal and sentence relevance. Using multilingual large language models (LLMs), we compute sentence surprisal through three methods, chain rule, next sentence prediction, and negative log‐likelihood, and apply a “memory‐aware” approach to calculate sentence‐level semantic relevance based on convolution operations. The sentence‐level metrics developed are tested and compared to validate whether they can predict the reading speed of sentences, and, further, we explore how sentence‐level metrics take effects on human processing and comprehending sentences as a whole across languages. The results show that sentence‐level metrics are highly capable of predicting sentence reading speed. Our results also indicate that these computational sentence‐level metrics are exceptionally effective at predicting and explaining the processing difficulties encountered by readers in processing sentences as a whole across a variety of languages. The proposed sentence‐level metrics offer significant interpretability and achieve high accuracy in predicting human sentence reading speed, as they capture unique aspects of comprehension difficulty beyond word‐level measures. These metrics serve as valuable computational tools for investigating human sentence processing and advancing our understanding of naturalistic reading. Their strong performance and generalization capabilities highlight their potential to drive progress at the intersection of LLMs and cognitive science.

Subjects

MeSH terms (MEDLINE)

ReadingComprehensionPsycholinguisticsLanguageHumansSemanticsMultilingualism

Author keywords

Dual mechanismEntire sentence processingMultilingual LLMsSemantic relevanceSentence surprisal

Authors and institutions

  • School of Foreign Languages, Tongji University.
  • Department of Linguistics, University of Tübingen.
  • NLP Institute, University of Stuttgart.

Funding

  • The Deutsche Forschungsgemeinschaft (DFG)

Cite

APA

Sun, K., & Wang, R. (2025). Computational Sentence‐Level Metrics of Reading Speed and Its Ramifications for Sentence Comprehension. Cognitive Science. https://doi.org/10.1111/cogs.70092

Vancouver

Sun K, Wang R. Computational Sentence‐Level Metrics of Reading Speed and Its Ramifications for Sentence Comprehension. Cognitive Science. 2025. doi:10.1111/cogs.70092

BibTeX
@article{Sun2025,
  author = {Sun, Kun and Wang, Rong},
  title = {Computational Sentence‐Level Metrics of Reading Speed and Its Ramifications for Sentence Comprehension},
  journal = {Cognitive Science},
  year = {2025},
  doi = {10.1111/cogs.70092}
}
Start for free →