EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

The role of semantically related co-speech gestures in English-to-Chinese consecutive interpreting: a behavioral and ERP study

Jifei Zhang, Zhao Yao

Acta Psychologica · 2026-11 · 271 · 108148

DOI: 10.1016/j.actpsy.2026.108148 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Acta Psychologica, 2026-11. Verfasst von Jifei Zhang und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Foreign Studies, Xi'an Jiaotong University, Xi'an, 710049, China; School of Foreign Studies, Xi'an University of Posts and Telecommunicatio…. Die Arbeit nennt 93 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Scientific Research Plan Projects of Shaanxi Education Department, Ministry of Education of the People's Republic of China Humanities and Social Sciences Youth Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Co-speech gestures are an important source of visual-semantic information in communication, yet how the semantic relatedness of speech and gesture influences both comprehension and production during consecutive interpreting (CI) remains insufficiently understood. To this end, the present study combined behavioral and event-related potential (ERP) measure to examine how semantically related and semantically unrelated co-speech gestures affect source-language comprehension and target-language production in English-to-Chinese CI through a cue-recall task and oral translation. The comprehension-related results showed that gesture condition did not significantly affect cue-recall accuracy, but semantically related gestures were associated with faster responses than semantically unrelated gestures. ERP results during real-time comprehension further showed that semantically related gestures elicited less negative N400 amplitudes, which were distributed along the anterior-posterior scalp axis and maximal over parietal sites. The production-related results showed translation scores were also higher in the semantically related gesture condition. These effects remained stable after verbal working memory was included as a covariate. Overall, the findings provide initial behavioral and neurocognitive evidence that co-speech gestures are integrated with speech during CI, and that reduced semantic relatedness between speech and gesture increases online semantic processing demands with downstream consequences for target-language production. The study advances a multimodal account of consecutive interpreting by showing that visually available co-speech gestures shape both source-language comprehension and subsequent target-language production.

Schlagwörter

Stichwörter der Autor:innen

Co-speech gestureConsecutive interpretingERPSemantic congruency

Autor:innen und Institutionen

  • School of Foreign Studies, Xi'an Jiaotong University, Xi'an, 710049, China; School of Foreign Studies, Xi'an University of Posts and Telecommunications, Xi'an, 710121, China. Electronic address: zhangjifei@xupt.edu.cn.
  • School of Foreign Studies, Xi'an Jiaotong University, Xi'an, 710049, China. Electronic address: yaozhao@xjtu.edu.cn.

Förderung

  • Scientific Research Plan Projects of Shaanxi Education Department
  • Ministry of Education of the People's Republic of China Humanities and Social Sciences Youth Foundation

Zitieren

APA

Zhang, J., & Yao, Z. (2026). The role of semantically related co-speech gestures in English-to-Chinese consecutive interpreting: a behavioral and ERP study. Acta Psychologica, 271, 108148. https://doi.org/10.1016/j.actpsy.2026.108148

Vancouver

Zhang J, Yao Z. The role of semantically related co-speech gestures in English-to-Chinese consecutive interpreting: a behavioral and ERP study. Acta Psychologica. 2026;271:108148. doi:10.1016/j.actpsy.2026.108148

BibTeX
@article{Zhang2026,
  author = {Zhang, Jifei and Yao, Zhao},
  title = {The role of semantically related co-speech gestures in English-to-Chinese consecutive interpreting: a behavioral and ERP study},
  journal = {Acta Psychologica},
  year = {2026},
  volume = {271},
  pages = {108148},
  doi = {10.1016/j.actpsy.2026.108148}
}
Kostenlos starten →