EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues

Ronny Bujok iD, Antje S Meyer, Hans Rutger Bosker iD

Language and Speech · 2025

DOI: 10.1177/00238309241258162 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Language and Speech, 2025. Verfasst von Ronny Bujok und 2 weiteren Autor:innen. Beteiligte Einrichtung: Max Planck Institute for Psycholinguistics, The Netherlands. Hauptthemen laut MEDLINE: Gestures, Cues, Speech Perception, Visual Perception. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: ERC Starting Grant.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Human communication is inherently multimodal. Auditory speech, but also visual cues can be used to understand another talker. Most studies of audiovisual speech perception have focused on the perception of speech segments (i.e., speech sounds). However, less is known about the influence of visual information on the perception of suprasegmental aspects of speech like lexical stress. In two experiments, we investigated the influence of different visual cues (e.g., facial articulatory cues and beat gestures) on the audiovisual perception of lexical stress. We presented auditory lexical stress continua of disyllabic Dutch stress pairs together with videos of a speaker producing stress on the first or second syllable (e.g., articulating VOORnaam or voorNAAM ). Moreover, we combined and fully crossed the face of the speaker producing lexical stress on either syllable with a gesturing body producing a beat gesture on either the first or second syllable. Results showed that people successfully used visual articulatory cues to stress in muted videos. However, in audiovisual conditions, we were not able to find an effect of visual articulatory cues. In contrast, we found that the temporal alignment of beat gestures with speech robustly influenced participants’ perception of lexical stress. These results highlight the importance of considering suprasegmental aspects of language in multimodal contexts.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

GesturesCuesSpeech PerceptionVisual PerceptionPhoneticsSpeech AcousticsHumansFemaleMaleYoung AdultAdultAcoustic StimulationPhotic Stimulation

Stichwörter der Autor:innen

Audiovisual speechbeat gestureslexical stressprosodyspeech perception

Autor:innen und Institutionen

  • Max Planck Institute for Psycholinguistics, The Netherlands.
  • International Max Planck Research School for Language Sciences, MPI for Psycholinguistics, Max Planck Society, The Netherlands.
  • Donders Institute for Brain, Cognition and Behaviour, Radboud University, The Netherlands.

ORCID-Profile: Ronny Bujok, Hans Rutger Bosker

Förderung

  • ERC Starting Grant

Zitieren

APA

Bujok, R., Meyer, A. S., & Bosker, H. R. (2025). Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues. Language and Speech. https://doi.org/10.1177/00238309241258162

Vancouver

Bujok R, Meyer AS, Bosker HR. Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues. Language and Speech. 2025. doi:10.1177/00238309241258162

BibTeX
@article{Bujok2025,
  author = {Bujok, Ronny and Meyer, Antje S and Bosker, Hans Rutger},
  title = {Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues},
  journal = {Language and Speech},
  year = {2025},
  doi = {10.1177/00238309241258162}
}
Kostenlos starten →