Turn-taking in human face-to-face interaction is multimodal: gaze direction and manual gestures aid the coordination of turn transitions
Philosophical Transactions of the Royal Society B · 24.04.2023 · 378 (1875)
DOI: 10.1098/rstb.2021.0473 ↗Kurz gefasst
Fachartikel in der Zeitschrift Philosophical Transactions of the Royal Society B, online erschienen am 06.03.2023. Verfasst von Kobin H Kendrick und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Language and Linguistic Science, University of York, York YO10 5DD, UK. Hauptthemen laut MEDLINE: Gestures, Linguistics. Die Arbeit wurde bisher 85-mal zitiert (Crossref) und nennt 113 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: European Research Council.
Abstract (Originalsprache)
Human communicative interaction is characterized by rapid and precise turn-taking. This is achieved by an intricate system that has been elucidated in the field of conversation analysis, based largely on the study of the auditory signal. This model suggests that transitions occur at points of possible completion identified in terms of linguistic units. Despite this, considerable evidence exists that visible bodily actions including gaze and gestures also play a role. To reconcile disparate models and observations in the literature, we combine qualitative and quantitative methods to analyse turn-taking in a corpus of multimodal interaction using eye-trackers and multiple cameras. We show that transitions seem to be inhibited when a speaker averts their gaze at a point of possible turn completion, or when a speaker produces gestures which are beginning or unfinished at such points. We further show that while the direction of a speaker's gaze does not affect the speed of transitions, the production of manual gestures does: turns with gestures have faster transitions. Our findings suggest that the coordination of transitions involves not only linguistic resources but also visual gestural ones and that the transition-relevance places in turns are multimodal in nature. This article is part of a discussion meeting issue ‘Face2face: advancing the science of social interaction’.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Language and Linguistic Science, University of York, York YO10 5DD, UK.
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
- Max Planck Institute for Psycholinguistics, Nijmegen, Gelderland, The Netherlands.
ORCID-Profile: Kobin H Kendrick, Stephen C Levinson
Förderung
- European Research Council
Zitieren
APA
Kendrick, K. H., Holler, J., & Levinson, S. C. (2023). Turn-taking in human face-to-face interaction is multimodal: gaze direction and manual gestures aid the coordination of turn transitions. Philosophical Transactions of the Royal Society B, 378(1875). https://doi.org/10.1098/rstb.2021.0473
Vancouver
Kendrick KH, Holler J, Levinson SC. Turn-taking in human face-to-face interaction is multimodal: gaze direction and manual gestures aid the coordination of turn transitions. Philosophical Transactions of the Royal Society B. 2023;378(1875). doi:10.1098/rstb.2021.0473
BibTeX
@article{Kendrick2023,
author = {Kendrick, Kobin H and Holler, Judith and Levinson, Stephen C},
title = {Turn-taking in human face-to-face interaction is multimodal: gaze direction and manual gestures aid the coordination of turn transitions},
journal = {Philosophical Transactions of the Royal Society B},
year = {2023},
volume = {378},
number = {1875},
doi = {10.1098/rstb.2021.0473}
}
EUVIMED