Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech
Social Cognitive and Affective Neuroscience · 2024
DOI: 10.1093/scan/nsae051 ↗Kurz gefasst
Fachartikel in der Zeitschrift Social Cognitive and Affective Neuroscience, 2024. Verfasst von Zhuoran Li und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychological and Cognitive Sciences, Tsinghua University, Beijing 100084, China. Hauptthemen laut MEDLINE: Speech Perception, Semantics, Brain. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Deutsche Forschungsgemeinschaft, National Natural Science Foundation of China.
Abstract (Originalsprache)
Recent research has extensively reported the phenomenon of inter-brain neural coupling between speakers and listeners during speech communication. Yet, the specific speech processes underlying this neural coupling remain elusive. To bridge this gap, this study estimated the correlation between the temporal dynamics of speaker–listener neural coupling with speech features, utilizing two inter-brain datasets accounting for different noise levels and listener’s language experiences (native vs. non-native). We first derived time-varying speaker–listener neural coupling, extracted acoustic feature (envelope) and semantic features (entropy and surprisal) from speech, and then explored their correlational relationship. Our findings reveal that in clear conditions, speaker–listener neural coupling correlates with semantic features. However, as noise increases, this correlation is only significant for native listeners. For non-native listeners, neural coupling correlates predominantly with acoustic feature rather than semantic features. These results revealed how speaker–listener neural coupling is associated with the acoustic and semantic features under various scenarios, enriching our understanding of the inter-brain neural mechanisms during natural speech communication. We therefore advocate for more attention on the dynamic nature of speaker–listener neural coupling and its modeling with multilevel speech features.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychological and Cognitive Sciences, Tsinghua University, Beijing 100084, China.
- Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing 100084, China.
- Department of Psychiatry, University of Iowa Carver College of Medicine, Iowa City, IA 52242, United States.
- Stead Family Department of Pediatrics, University of Iowa Carver College of Medicine, Iowa City, IA 52242, United States.
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China.
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg Eppendorf, Hamburg 20246, Germany.
Förderung
- Deutsche Forschungsgemeinschaft
- National Natural Science Foundation of China
Zitieren
APA
Li, Z., Hong, B., Nolte, G., Engel, A. K., & Zhang, D. (2024). Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech. Social Cognitive and Affective Neuroscience. https://doi.org/10.1093/scan/nsae051
Vancouver
Li Z, Hong B, Nolte G, Engel AK, Zhang D. Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech. Social Cognitive and Affective Neuroscience. 2024. doi:10.1093/scan/nsae051
BibTeX
@article{Li2024,
author = {Li, Zhuoran and Hong, Bo and Nolte, Guido and Engel, Andreas K and Zhang, Dan},
title = {Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech},
journal = {Social Cognitive and Affective Neuroscience},
year = {2024},
doi = {10.1093/scan/nsae051}
}
EUVIMED