Finding structure during incremental speech comprehension
eLife · 05.04.2024 · 12
DOI: 10.7554/elife.89311 ↗Kurz gefasst
Fachartikel in der Zeitschrift eLife, online erschienen am 05.04.2024. Verfasst von Bingjiang Lyu und 3 weiteren Autor:innen. Beteiligte Einrichtung: Changping Laboratory, Beijing, China. Hauptthemen laut MEDLINE: Comprehension, Speech. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Research Council, Ministry of Science and Technology of the People's Republic of China, Chanping Laboratory.
Abstract (Originalsprache)
A core aspect of human speech comprehension is the ability to incrementally integrate consecutive words into a structured and coherent interpretation, aligning with the speaker’s intended meaning. This rapid process is subject to multidimensional probabilistic constraints, including both linguistic knowledge and non-linguistic information within specific contexts, and it is their interpretative coherence that drives successful comprehension. To study the neural substrates of this process, we extract word-by-word measures of sentential structure from BERT, a deep language model, which effectively approximates the coherent outcomes of the dynamic interplay among various types of constraints. Using representational similarity analysis, we tested BERT parse depths and relevant corpus-based measures against the spatiotemporally resolved brain activity recorded by electro-/magnetoencephalography when participants were listening to the same sentences. Our results provide a detailed picture of the neurobiological processes involved in the incremental construction of structured interpretations. These findings show when and where coherent interpretations emerge through the evaluation and integration of multifaceted constraints in the brain, which engages bilateral brain regions extending beyond the classical fronto-temporal language system. Furthermore, this study provides empirical evidence supporting the use of artificial neural networks as computational models for revealing the neural dynamics underpinning complex cognitive processes in the brain.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Changping Laboratory, Beijing, China.
- Centre for Speech, Language and the Brain, Department of Psychology, University of Cambridge, Cambridge, United Kingdom.
ORCID-Profile: Bingjiang Lyu
Förderung
- European Research Council
- Ministry of Science and Technology of the People's Republic of China
- Chanping Laboratory
Zitieren
APA
Lyu, B., Marslen-Wilson, W. D., Fang, Y., & Tyler, L. K. (2024). Finding structure during incremental speech comprehension. eLife, 12. https://doi.org/10.7554/elife.89311
Vancouver
Lyu B, Marslen-Wilson WD, Fang Y, Tyler LK. Finding structure during incremental speech comprehension. eLife. 2024;12. doi:10.7554/elife.89311
BibTeX
@article{Lyu2024,
author = {Lyu, Bingjiang and Marslen-Wilson, William D and Fang, Yuxing and Tyler, Lorraine K},
title = {Finding structure during incremental speech comprehension},
journal = {eLife},
year = {2024},
volume = {12},
doi = {10.7554/elife.89311}
}
EUVIMED