From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation
PLOS ONE · 2024
DOI: 10.1371/journal.pone.0309831 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Tifenn Fauviaux und 4 weiteren Autor:innen. Beteiligte Einrichtung: EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Montpellier, France. Hauptthemen laut MEDLINE: Gestures, Speech, Cues. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 101 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agence Nationale de la Recherche.
Abstract (Originalsprache)
Conversations encompass continuous exchanges of verbal and nonverbal information. Previous research has demonstrated that gestures dynamically entrain each other and that speakers tend to align their vocal properties. While gesture and speech are known to synchronize at the intrapersonal level, few studies have investigated the multimodal dynamics of gesture/speech between individuals. The present study aims to extend our comprehension of unimodal dynamics of speech and gesture to multimodal speech/gesture dynamics. We used an online dataset of 14 dyads engaged in unstructured conversation. Speech and gesture synchronization was measured with cross-wavelets at different timescales. Results supported previous research on intrapersonal speech/gesture coordination, finding synchronization at all timescales of the conversation. Extending the literature, we also found interpersonal synchronization between speech and gesture. Given that the unimodal and multimodal synchronization occurred at similar timescales, we suggest that synchronization likely depends on the vocal channel, particularly on the turn-taking dynamics of the conversation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Montpellier, France.
- College of the Holy Cross, Worcester, MA, United States of America.
- CY Cergy Paris Université - ETIS UMR 8051, Cergy, Pontoise, France.
ORCID-Profile: Tifenn Fauviaux, Ghilès Mostafaoui
Förderung
- Agence Nationale de la Recherche
Zitieren
APA
Fauviaux, T., Marin, L., Parisi, M., Schmidt, R., & Mostafaoui, G. (2024). From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation. PLOS ONE. https://doi.org/10.1371/journal.pone.0309831
Vancouver
Fauviaux T, Marin L, Parisi M, Schmidt R, Mostafaoui G. From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation. PLOS ONE. 2024. doi:10.1371/journal.pone.0309831
BibTeX
@article{Fauviaux2024,
author = {Fauviaux, Tifenn and Marin, Ludovic and Parisi, Mathilde and Schmidt, Richard and Mostafaoui, Ghilès},
title = {From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation},
journal = {PLOS ONE},
year = {2024},
doi = {10.1371/journal.pone.0309831}
}
EUVIMED