EUVIMEDEUVIMED entdecken
Crossref

Do acoustic cues influence the McGurk effect—an audiovisual speech illusion?

Ilmari Toivo Johannes Moisio iD, Tarja Peromaa iD, Lari Vainio iD, Martti Vainio iD, Kaisa Tiippana iD

The Journal of the Acoustical Society of America · 01.05.2026 · 159 (5) · 4786-4796

DOI: 10.1121/10.0043923 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, online erschienen am 28.05.2026. Verfasst von Ilmari Toivo Johannes Moisio und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Helsinki, Helsinki 00014, Finland. Hauptthemen laut MEDLINE: Cues, Speech Perception, Illusions, Speech Acoustics. Die Arbeit nennt 41 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual and auditory information are seamlessly integrated when speech is perceived. This is illustrated by the McGurk effect, where incongruent visual information from the speaker's face alters the consonant the listener hears. However, it remains unclear how acoustic features of speech influence this illusion. In this study, perceptual data from 52 listeners exposed to McGurk stimuli (acoustic [pa] with visual [ka] spoken by four speakers) were combined with acoustic analyses of [pa], [ta], and [ka] to examine whether key features of plosive consonants, the noise burst, and formant transitions influence the effect. The following six acoustic cues of these features were analyzed: the center of gravity and duration of the noise burst and the frequency range and duration of the second and third formant transitions. Linear mixed modeling showed that most of these features contributed to the illusion, with the duration of the second formant transition being the strongest cue. In some cases, perception shifted as the acoustic difference decreased; for example, the McGurk stimulus was heard more as TA when the second formant transition of [pa] resembled that of [ta]. This study demonstrated that specific acoustic phonetic cues contribute systematically to the McGurk effect.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CuesSpeech PerceptionIllusionsSpeech AcousticsVisual PerceptionHumansAcoustic StimulationFemaleMaleYoung AdultAdultPhoneticsPhotic StimulationTime FactorsNoiseAcoustics

Autor:innen und Institutionen

  • Department of Psychology, University of Helsinki, Helsinki 00014, Finland.
  • Department of Digital Humanities, University of Helsinki, Helsinki 00014, Finland.

ORCID-Profile: Ilmari Toivo Johannes Moisio, Tarja Peromaa, Lari Vainio, Martti Vainio, Kaisa Tiippana

Zitieren

APA

Moisio, I. T. J., Peromaa, T., Vainio, L., Vainio, M., & Tiippana, K. (2026). Do acoustic cues influence the McGurk effect—an audiovisual speech illusion?. The Journal of the Acoustical Society of America, 159(5), 4786-4796. https://doi.org/10.1121/10.0043923

Vancouver

Moisio ITJ, Peromaa T, Vainio L, Vainio M, Tiippana K. Do acoustic cues influence the McGurk effect—an audiovisual speech illusion?. The Journal of the Acoustical Society of America. 2026;159(5):4786-4796. doi:10.1121/10.0043923

BibTeX
@article{Moisio2026,
  author = {Moisio, Ilmari Toivo Johannes and Peromaa, Tarja and Vainio, Lari and Vainio, Martti and Tiippana, Kaisa},
  title = {Do acoustic cues influence the McGurk effect—an audiovisual speech illusion?},
  journal = {The Journal of the Acoustical Society of America},
  year = {2026},
  volume = {159},
  number = {5},
  pages = {4786--4796},
  doi = {10.1121/10.0043923}
}
Kostenlos starten →