EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Finding structure during incremental speech comprehension

Bingjiang Lyu iD, William D Marslen-Wilson, Yuxing Fang, Lorraine K Tyler

eLife · 05.04.2024 · 12

DOI: 10.7554/elife.89311 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eLife, online erschienen am 05.04.2024. Verfasst von Bingjiang Lyu und 3 weiteren Autor:innen. Beteiligte Einrichtung: Changping Laboratory, Beijing, China. Hauptthemen laut MEDLINE: Comprehension, Speech. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Research Council, Ministry of Science and Technology of the People's Republic of China, Chanping Laboratory.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A core aspect of human speech comprehension is the ability to incrementally integrate consecutive words into a structured and coherent interpretation, aligning with the speaker’s intended meaning. This rapid process is subject to multidimensional probabilistic constraints, including both linguistic knowledge and non-linguistic information within specific contexts, and it is their interpretative coherence that drives successful comprehension. To study the neural substrates of this process, we extract word-by-word measures of sentential structure from BERT, a deep language model, which effectively approximates the coherent outcomes of the dynamic interplay among various types of constraints. Using representational similarity analysis, we tested BERT parse depths and relevant corpus-based measures against the spatiotemporally resolved brain activity recorded by electro-/magnetoencephalography when participants were listening to the same sentences. Our results provide a detailed picture of the neurobiological processes involved in the incremental construction of structured interpretations. These findings show when and where coherent interpretations emerge through the evaluation and integration of multifaceted constraints in the brain, which engages bilateral brain regions extending beyond the classical fronto-temporal language system. Furthermore, this study provides empirical evidence supporting the use of artificial neural networks as computational models for revealing the neural dynamics underpinning complex cognitive processes in the brain.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ComprehensionSpeechHumansBrainMagnetoencephalographyLanguage

Stichwörter der Autor:innen

EEGMEGdeep language modelselectroencephalographyhumanincremental speech comprehensionmagnetoencephalographyneuroscienceparsingsentence structure

Autor:innen und Institutionen

  • Changping Laboratory, Beijing, China.
  • Centre for Speech, Language and the Brain, Department of Psychology, University of Cambridge, Cambridge, United Kingdom.

ORCID-Profile: Bingjiang Lyu

Förderung

  • European Research Council
  • Ministry of Science and Technology of the People's Republic of China
  • Chanping Laboratory

Zitieren

APA

Lyu, B., Marslen-Wilson, W. D., Fang, Y., & Tyler, L. K. (2024). Finding structure during incremental speech comprehension. eLife, 12. https://doi.org/10.7554/elife.89311

Vancouver

Lyu B, Marslen-Wilson WD, Fang Y, Tyler LK. Finding structure during incremental speech comprehension. eLife. 2024;12. doi:10.7554/elife.89311

BibTeX
@article{Lyu2024,
  author = {Lyu, Bingjiang and Marslen-Wilson, William D and Fang, Yuxing and Tyler, Lorraine K},
  title = {Finding structure during incremental speech comprehension},
  journal = {eLife},
  year = {2024},
  volume = {12},
  doi = {10.7554/elife.89311}
}
Kostenlos starten →