Multidimensional Labeling of Gesture in Communication: the M3D Proposal
Corpus Pragmatics · 2025-12 · 9 (4) · 411-433
DOI: 10.1007/s41701-025-00197-2 ↗Kurz gefasst
Fachartikel in der Zeitschrift Corpus Pragmatics, online erschienen am 26.06.2025. Verfasst von Patrick Louis Rohrer und 7 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 71 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Ciencia, Innovación y Universidades, Ministerio de Ciencia e Innovación, Generalitat de Catalunya.
Abstract (Originalsprache)
Communication is multimodal in that speakers use not only their voices, but also co-speech gestures to communicate. Recent insights suggest that gestural behavior has a strong association with prosodic structure and that a single gesture can communicate various semantic and pragmatic meanings. This highlights the importance of developing a comprehensive, flexible, and transparent approach to gesture annotation that accounts for multiple dimensions of gesture, including a gesture’s form, prosodic properties, and semantic and pragmatic contributions. To address this need for an increasingly dimensionalized approach to multimodal data annotation, the main goal of this paper is to present and describe a novel labeling system for manual gestures. The MultiModal MultiDimensional (M3D) system consists of an open access package that has been developed in coordination with five different labs working on gesture and its interaction with speech. The package includes a set of reliable annotation guidelines, a validated training program, and two annotated audiovisual corpora that represent over 60 minutes of lecture-style speech.
Förderung
- Ministerio de Ciencia, Innovación y Universidades
- Ministerio de Ciencia e Innovación
- Generalitat de Catalunya
- Danmarks Frie Forskningsfond
Zitieren
APA
Rohrer, P. L., Tütüncübasi, U., Florit-Pons, J., Vilà-Giménez, I., Esteve-Gibert, N., Ren-Mitchell, A., Shattuck-Hufnagel, S., & Prieto, P. (2025). Multidimensional Labeling of Gesture in Communication: the M3D Proposal. Corpus Pragmatics, 9(4), 411-433. https://doi.org/10.1007/s41701-025-00197-2
Vancouver
Rohrer PL, Tütüncübasi U, Florit-Pons J, Vilà-Giménez I, Esteve-Gibert N, Ren-Mitchell A, et al. Multidimensional Labeling of Gesture in Communication: the M3D Proposal. Corpus Pragmatics. 2025;9(4):411-433. doi:10.1007/s41701-025-00197-2
BibTeX
@article{Rohrer2025,
author = {Rohrer, Patrick Louis and Tütüncübasi, Ulya and Florit-Pons, Júlia and Vilà-Giménez, Ingrid and Esteve-Gibert, Núria and Ren-Mitchell, Ada and Shattuck-Hufnagel, Stefanie and Prieto, Pilar},
title = {Multidimensional Labeling of Gesture in Communication: the M3D Proposal},
journal = {Corpus Pragmatics},
year = {2025},
volume = {9},
number = {4},
pages = {411--433},
doi = {10.1007/s41701-025-00197-2}
}
EUVIMED