EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation

Tifenn Fauviaux iD, Ludovic Marin, Mathilde Parisi, Richard Schmidt, Ghilès Mostafaoui iD

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0309831 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Tifenn Fauviaux und 4 weiteren Autor:innen. Beteiligte Einrichtung: EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Montpellier, France. Hauptthemen laut MEDLINE: Gestures, Speech, Cues. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 101 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agence Nationale de la Recherche.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Conversations encompass continuous exchanges of verbal and nonverbal information. Previous research has demonstrated that gestures dynamically entrain each other and that speakers tend to align their vocal properties. While gesture and speech are known to synchronize at the intrapersonal level, few studies have investigated the multimodal dynamics of gesture/speech between individuals. The present study aims to extend our comprehension of unimodal dynamics of speech and gesture to multimodal speech/gesture dynamics. We used an online dataset of 14 dyads engaged in unstructured conversation. Speech and gesture synchronization was measured with cross-wavelets at different timescales. Results supported previous research on intrapersonal speech/gesture coordination, finding synchronization at all timescales of the conversation. Extending the literature, we also found interpersonal synchronization between speech and gesture. Given that the unimodal and multimodal synchronization occurred at similar timescales, we suggest that synchronization likely depends on the vocal channel, particularly on the turn-taking dynamics of the conversation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

GesturesSpeechCuesHumansFemaleMaleAdultNonverbal CommunicationYoung AdultVerbal BehaviorInterpersonal RelationsCommunication

Autor:innen und Institutionen

  • EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Montpellier, France.
  • College of the Holy Cross, Worcester, MA, United States of America.
  • CY Cergy Paris Université - ETIS UMR 8051, Cergy, Pontoise, France.

ORCID-Profile: Tifenn Fauviaux, Ghilès Mostafaoui

Förderung

  • Agence Nationale de la Recherche

Zitieren

APA

Fauviaux, T., Marin, L., Parisi, M., Schmidt, R., & Mostafaoui, G. (2024). From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation. PLOS ONE. https://doi.org/10.1371/journal.pone.0309831

Vancouver

Fauviaux T, Marin L, Parisi M, Schmidt R, Mostafaoui G. From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation. PLOS ONE. 2024. doi:10.1371/journal.pone.0309831

BibTeX
@article{Fauviaux2024,
  author = {Fauviaux, Tifenn and Marin, Ludovic and Parisi, Mathilde and Schmidt, Richard and Mostafaoui, Ghilès},
  title = {From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0309831}
}
Kostenlos starten →