Multimodal Integration of Cognitive and Embodied Processes in Interpreting
Alfred Nobel University Journal of Philology · 04.06.2026 · 1 (31) · 409-421
DOI: 10.32342/anujph.2026.31.23 ↗Kurz gefasst
Fachartikel in der Zeitschrift Alfred Nobel University Journal of Philology, online erschienen am 04.06.2026. Verfasst von Oleksandr Sodel.
Abstract (Originalsprache)
This study reveals the multimodal integration of cognitive and embodied processes in interpreting by examining the interaction of verbal, visual, and kinetic modalities, focusing on gestures, gaze, and eye contact in meaning formation, managing cognitive load, and communication effectiveness in both simultaneous and consecutive interpreting. The study reviews theoretical framework and previous research on multimodality, analyzes interpreter performance using integrated eye-tracking and gesture analysis, examines the coordination of visual attention and bodily movements at different stages of interpreting, identifies patterns of multimodal synchronization and their cognitive-pragmatic consequences, and proposes a multimodal model of interpreting process that integrates cognitive processing with bodily interaction. Using a mixed-methods design, the study analyzed conference speeches, simulated dialogues, and short texts, coding gaze and gestures to examine their coherence with speech and linking visual-kinetic behaviour to performance metrics groups of experienced professional interpreters and graduate student interpreters with different experience levels. The results reveal a dynamic interplay of bodily actions and cognitive processes. Gestures served as external memory aids: subtle pointing or rhythmic movements facilitated the structuring of information and the memorization of terminology, reducing cognitive load and freeing working memory for comprehension and retrieval. Gaze patterns reflected attentional strategies: experienced professional interpreters proactively anticipated key information, while graduate student interpreters demonstrated a reactive gaze, sometimes delaying paraphrasing. Brief gaze directed at the audience during the transmission indicated monitoring comprehension, maintaining alignment and pragmatic coherence. Gestures and gaze played a central role in regulating clarity, emphasis, and audience engagement. Rhythmic gestures enhanced prosody and highlighted key terms, synchronized gaze movements marked discourse segmentation, and deictic and iconic gestures facilitated referent tracking and discourse organization. Graduate student interpreters sometimes relied on spontaneous gestures misaligned with the rhythm of speech, which could reduce coherence. Differences related to mode were identified: simultaneous interpreting required minimalist, rhythmic gestures and brief, strategic gaze fixations due to its high cognitive load, whereas consecutive interpreting allowed for more focused multimodal orchestration, broader gaze movements, and a variety of gestures to structure discourse and enhance expressiveness. The study presents a multimodal model of interpreting as an integrated system of cognitive and bodily processes, where gaze cues attention, gestures serve as memory aids and communicative tools, and verbal output with prosody interact with these modalities to enhance clarity and coherence. Temporal synchronization of verbal, visual, and kinetic channels ensures effective coordination of multimodal resources, supporting accuracy, fluency, and pragmatic coherence. Overall, the findings confirm that interpreting is inherently multimodal process, and bodily behaviours serve as integrated cognitive strategies. Effective coordination of modalities improves cognitive control, clarity of delivery, and audience engagement, highlighting the importance of incorporating multimodal strategies into interpreter training.
Zitieren
APA
Sodel, O. (2026). Multimodal Integration of Cognitive and Embodied Processes in Interpreting. Alfred Nobel University Journal of Philology, 1(31), 409-421. https://doi.org/10.32342/anujph.2026.31.23
Vancouver
Sodel O. Multimodal Integration of Cognitive and Embodied Processes in Interpreting. Alfred Nobel University Journal of Philology. 2026;1(31):409-421. doi:10.32342/anujph.2026.31.23
BibTeX
@article{Sodel2026,
author = {Sodel, Oleksandr},
title = {Multimodal Integration of Cognitive and Embodied Processes in Interpreting},
journal = {Alfred Nobel University Journal of Philology},
year = {2026},
volume = {1},
number = {31},
pages = {409--421},
doi = {10.32342/anujph.2026.31.23}
}
EUVIMED