EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech

Zhuoran Li, Bo Hong iD, Guido Nolte, Andreas K Engel, Dan Zhang iD

Social Cognitive and Affective Neuroscience · 2024

DOI: 10.1093/scan/nsae051 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Social Cognitive and Affective Neuroscience, 2024. Verfasst von Zhuoran Li und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychological and Cognitive Sciences, Tsinghua University, Beijing 100084, China. Hauptthemen laut MEDLINE: Speech Perception, Semantics, Brain. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Deutsche Forschungsgemeinschaft, National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent research has extensively reported the phenomenon of inter-brain neural coupling between speakers and listeners during speech communication. Yet, the specific speech processes underlying this neural coupling remain elusive. To bridge this gap, this study estimated the correlation between the temporal dynamics of speaker–listener neural coupling with speech features, utilizing two inter-brain datasets accounting for different noise levels and listener’s language experiences (native vs. non-native). We first derived time-varying speaker–listener neural coupling, extracted acoustic feature (envelope) and semantic features (entropy and surprisal) from speech, and then explored their correlational relationship. Our findings reveal that in clear conditions, speaker–listener neural coupling correlates with semantic features. However, as noise increases, this correlation is only significant for native listeners. For non-native listeners, neural coupling correlates predominantly with acoustic feature rather than semantic features. These results revealed how speaker–listener neural coupling is associated with the acoustic and semantic features under various scenarios, enriching our understanding of the inter-brain neural mechanisms during natural speech communication. We therefore advocate for more attention on the dynamic nature of speaker–listener neural coupling and its modeling with multilevel speech features.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Speech PerceptionSemanticsBrainHumansFemaleMaleAdultYoung AdultSpeechElectroencephalography

Stichwörter der Autor:innen

acoustic featurefunctional near-infrared spectroscopy (fNIRS)naturalistic speechsemantic featurespeaker–listener neural coupling

Autor:innen und Institutionen

  • Department of Psychological and Cognitive Sciences, Tsinghua University, Beijing 100084, China.
  • Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing 100084, China.
  • Department of Psychiatry, University of Iowa Carver College of Medicine, Iowa City, IA 52242, United States.
  • Stead Family Department of Pediatrics, University of Iowa Carver College of Medicine, Iowa City, IA 52242, United States.
  • Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China.
  • Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg Eppendorf, Hamburg 20246, Germany.

ORCID-Profile: Bo Hong, Dan Zhang

Förderung

  • Deutsche Forschungsgemeinschaft
  • National Natural Science Foundation of China

Zitieren

APA

Li, Z., Hong, B., Nolte, G., Engel, A. K., & Zhang, D. (2024). Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech. Social Cognitive and Affective Neuroscience. https://doi.org/10.1093/scan/nsae051

Vancouver

Li Z, Hong B, Nolte G, Engel AK, Zhang D. Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech. Social Cognitive and Affective Neuroscience. 2024. doi:10.1093/scan/nsae051

BibTeX
@article{Li2024,
  author = {Li, Zhuoran and Hong, Bo and Nolte, Guido and Engel, Andreas K and Zhang, Dan},
  title = {Speaker–listener neural coupling correlates with semantic and acoustic features of naturalistic speech},
  journal = {Social Cognitive and Affective Neuroscience},
  year = {2024},
  doi = {10.1093/scan/nsae051}
}
Kostenlos starten →