EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multidimensional Labeling of Gesture in Communication: the M3D Proposal

Patrick Louis Rohrer, Ulya Tütüncübasi, Júlia Florit-Pons, Ingrid Vilà-Giménez, Núria Esteve-Gibert, Ada Ren-Mitchell, Stefanie Shattuck-Hufnagel, Pilar Prieto

Corpus Pragmatics · 2025-12 · 9 (4) · 411-433

DOI: 10.1007/s41701-025-00197-2 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Corpus Pragmatics, online erschienen am 26.06.2025. Verfasst von Patrick Louis Rohrer und 7 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 71 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Ciencia, Innovación y Universidades, Ministerio de Ciencia e Innovación, Generalitat de Catalunya.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Communication is multimodal in that speakers use not only their voices, but also co-speech gestures to communicate. Recent insights suggest that gestural behavior has a strong association with prosodic structure and that a single gesture can communicate various semantic and pragmatic meanings. This highlights the importance of developing a comprehensive, flexible, and transparent approach to gesture annotation that accounts for multiple dimensions of gesture, including a gesture’s form, prosodic properties, and semantic and pragmatic contributions. To address this need for an increasingly dimensionalized approach to multimodal data annotation, the main goal of this paper is to present and describe a novel labeling system for manual gestures. The MultiModal MultiDimensional (M3D) system consists of an open access package that has been developed in coordination with five different labs working on gesture and its interaction with speech. The package includes a set of reliable annotation guidelines, a validated training program, and two annotated audiovisual corpora that represent over 60 minutes of lecture-style speech.

Förderung

  • Ministerio de Ciencia, Innovación y Universidades
  • Ministerio de Ciencia e Innovación
  • Generalitat de Catalunya
  • Danmarks Frie Forskningsfond

Zitieren

APA

Rohrer, P. L., Tütüncübasi, U., Florit-Pons, J., Vilà-Giménez, I., Esteve-Gibert, N., Ren-Mitchell, A., Shattuck-Hufnagel, S., & Prieto, P. (2025). Multidimensional Labeling of Gesture in Communication: the M3D Proposal. Corpus Pragmatics, 9(4), 411-433. https://doi.org/10.1007/s41701-025-00197-2

Vancouver

Rohrer PL, Tütüncübasi U, Florit-Pons J, Vilà-Giménez I, Esteve-Gibert N, Ren-Mitchell A, et al. Multidimensional Labeling of Gesture in Communication: the M3D Proposal. Corpus Pragmatics. 2025;9(4):411-433. doi:10.1007/s41701-025-00197-2

BibTeX
@article{Rohrer2025,
  author = {Rohrer, Patrick Louis and Tütüncübasi, Ulya and Florit-Pons, Júlia and Vilà-Giménez, Ingrid and Esteve-Gibert, Núria and Ren-Mitchell, Ada and Shattuck-Hufnagel, Stefanie and Prieto, Pilar},
  title = {Multidimensional Labeling of Gesture in Communication: the M3D Proposal},
  journal = {Corpus Pragmatics},
  year = {2025},
  volume = {9},
  number = {4},
  pages = {411--433},
  doi = {10.1007/s41701-025-00197-2}
}
Kostenlos starten →