Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues
Language and Speech · 2025
DOI: 10.1177/00238309241258162 ↗Kurz gefasst
Fachartikel in der Zeitschrift Language and Speech, 2025. Verfasst von Ronny Bujok und 2 weiteren Autor:innen. Beteiligte Einrichtung: Max Planck Institute for Psycholinguistics, The Netherlands. Hauptthemen laut MEDLINE: Gestures, Cues, Speech Perception, Visual Perception. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: ERC Starting Grant.
Abstract (Originalsprache)
Human communication is inherently multimodal. Auditory speech, but also visual cues can be used to understand another talker. Most studies of audiovisual speech perception have focused on the perception of speech segments (i.e., speech sounds). However, less is known about the influence of visual information on the perception of suprasegmental aspects of speech like lexical stress. In two experiments, we investigated the influence of different visual cues (e.g., facial articulatory cues and beat gestures) on the audiovisual perception of lexical stress. We presented auditory lexical stress continua of disyllabic Dutch stress pairs together with videos of a speaker producing stress on the first or second syllable (e.g., articulating VOORnaam or voorNAAM ). Moreover, we combined and fully crossed the face of the speaker producing lexical stress on either syllable with a gesturing body producing a beat gesture on either the first or second syllable. Results showed that people successfully used visual articulatory cues to stress in muted videos. However, in audiovisual conditions, we were not able to find an effect of visual articulatory cues. In contrast, we found that the temporal alignment of beat gestures with speech robustly influenced participants’ perception of lexical stress. These results highlight the importance of considering suprasegmental aspects of language in multimodal contexts.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Max Planck Institute for Psycholinguistics, The Netherlands.
- International Max Planck Research School for Language Sciences, MPI for Psycholinguistics, Max Planck Society, The Netherlands.
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, The Netherlands.
ORCID-Profile: Ronny Bujok, Hans Rutger Bosker
Förderung
- ERC Starting Grant
Zitieren
APA
Bujok, R., Meyer, A. S., & Bosker, H. R. (2025). Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues. Language and Speech. https://doi.org/10.1177/00238309241258162
Vancouver
Bujok R, Meyer AS, Bosker HR. Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues. Language and Speech. 2025. doi:10.1177/00238309241258162
BibTeX
@article{Bujok2025,
author = {Bujok, Ronny and Meyer, Antje S and Bosker, Hans Rutger},
title = {Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues},
journal = {Language and Speech},
year = {2025},
doi = {10.1177/00238309241258162}
}
EUVIMED