EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hand Gestures Have Predictive Potential During Conversation: An Investigation of the Timing of Gestures in Relation to Speech

Marlijn Ter Bekke iD, Linda Drijvers, Judith Holler

Cognitive Science · 2024

DOI: 10.1111/cogs.13407 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cognitive Science, 2024. Verfasst von Marlijn Ter Bekke und 2 weiteren Autor:innen. Beteiligte Einrichtung: Donders Institute for Brain, Cognition and Behaviour, Radboud University. Hauptthemen laut MEDLINE: Speech, Gestures. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 131 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Research Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

During face‐to‐face conversation, transitions between speaker turns are incredibly fast. These fast turn exchanges seem to involve next speakers predicting upcoming semantic information, such that next turn planning can begin before a current turn is complete. Given that face‐to‐face conversation also involves the use of communicative bodily signals, an important question is how bodily signals such as co‐speech hand gestures play into these processes of prediction and fast responding. In this corpus study, we found that hand gestures that depict or refer to semantic information started before the corresponding information in speech, which held both for the onset of the gesture as a whole, as well as the onset of the stroke (the most meaningful part of the gesture). This early timing potentially allows listeners to use the gestural information to predict the corresponding semantic information to be conveyed in speech. Moreover, we provided further evidence that questions with gestures got faster responses than questions without gestures. However, we found no evidence for the idea that how much a gesture precedes its lexical affiliate (i.e., its predictive potential) relates to how fast responses were given. The findings presented here highlight the importance of the temporal relation between speech and gesture and help to illuminate the potential mechanisms underpinning multimodal language processing during face‐to‐face conversation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SpeechGesturesHumansLanguageSemanticsComprehension

Stichwörter der Autor:innen

ConversationGestureLanguageMultimodal communicationPredictionTurn-taking

Autor:innen und Institutionen

  • Donders Institute for Brain, Cognition and Behaviour, Radboud University.
  • Max Planck Institute for Psycholinguistics.

ORCID-Profile: Marlijn Ter Bekke

Förderung

  • European Research Council

Zitieren

APA

Ter Bekke, M., Drijvers, L., & Holler, J. (2024). Hand Gestures Have Predictive Potential During Conversation: An Investigation of the Timing of Gestures in Relation to Speech. Cognitive Science. https://doi.org/10.1111/cogs.13407

Vancouver

Ter Bekke M, Drijvers L, Holler J. Hand Gestures Have Predictive Potential During Conversation: An Investigation of the Timing of Gestures in Relation to Speech. Cognitive Science. 2024. doi:10.1111/cogs.13407

BibTeX
@article{TerBekke2024,
  author = {Ter Bekke, Marlijn and Drijvers, Linda and Holler, Judith},
  title = {Hand Gestures Have Predictive Potential During Conversation: An Investigation of the Timing of Gestures in Relation to Speech},
  journal = {Cognitive Science},
  year = {2024},
  doi = {10.1111/cogs.13407}
}
Kostenlos starten →