EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Audiovisual integration of speech: evidence for increased accuracy in “talk” versus “listen” condition

Lefteris Themelis Zografos, Anna Konstantoulaki, Christoph Klein, Argiro Vatakis, Nikolaos Smyrnis

Experimental Brain Research · 2025

DOI: 10.1007/s00221-025-07088-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Experimental Brain Research, 2025. Verfasst von Lefteris Themelis Zografos und 4 weiteren Autor:innen. Beteiligte Einrichtung: Laboratory of Cognitive Neuroscience and Sensorimotor Control, University Mental Health Neurosciences and Precision Medicine Research Institute "COST…. Hauptthemen laut MEDLINE: Visual Perception, Speech Perception, Auditory Perception, Speech. Die Arbeit nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Athens.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Processing of sensory stimuli generated by our own actions differs from that of externally generated stimuli. However, most evidence regarding this phenomenon concerns the processing of unisensory stimuli. A few studies have explored the effect of self-generated actions on multisensory stimuli and how it affects the integration of these stimuli. Most of them used abstract stimuli (e.g., flashes, beeps) rather than more natural ones such as sensations that are commonly correlated with actions that we perform in our everyday lives such as speech. In the current study, we explored the effect of self-generated action on the process of multisensory integration (MSI) during speech. We used a novel paradigm where participants were either listening to the echo of their own speech, while watching a video of themselves producing the same speech (“talk”, active condition), or they listened to their previously recorded speech and watched the prerecorded video of themselves producing the same speech (“listen”, passive condition). In both conditions, different stimulus onset asynchronies were introduced between the auditory and visual streams and participants were asked to perform simultaneity judgments. Using these judgments, we determined temporal binding windows (TBW) of integration for each participant and condition. We found that the TBW was significantly smaller in the active as compared to the passive condition indicating more accurate MSI. These results support the conclusion that sensory perception is modulated by self-generated action at the multisensory in addition to the unisensory level.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Visual PerceptionSpeech PerceptionAuditory PerceptionSpeechHumansMaleFemaleAdultYoung AdultPhotic StimulationAcoustic StimulationJudgment

Stichwörter der Autor:innen

MovementMultisensory integrationSelf-generated actionSpeechTemporal binding window

Autor:innen und Institutionen

  • Laboratory of Cognitive Neuroscience and Sensorimotor Control, University Mental Health Neurosciences and Precision Medicine Research Institute "COSTAS STEFANIS", Athens, Greece.
  • Multisensory and Temporal Processing Laboratory (MultiTimeLab), Department of Psychology, Panteion University of Social and Political Sciences, Athens, Greece.
  • 2nd Psychiatry Department, National, and Kapodistrian University of Athens, Medical School, University General Hospital «AΤΤΙΚΟΝ», Athens, Greece.
  • Department of Child and Adolescent Psychiatry, University of Freiburg, Freiburg im Breisgau, Germany.
  • Department of Child and Adolescent Psychiatry, Medical Faculty, University of Cologne, Cologne, Germany.
  • Multisensory and Temporal Processing Laboratory (MultiTimeLab), Department of Psychology, Panteion University of Social and Political Sciences, Athens, Greece. argiro.vatakis@gmail.com.

Förderung

  • University of Athens

Zitieren

APA

Zografos, L. T., Konstantoulaki, A., Klein, C., Vatakis, A., & Smyrnis, N. (2025). Audiovisual integration of speech: evidence for increased accuracy in “talk” versus “listen” condition. Experimental Brain Research. https://doi.org/10.1007/s00221-025-07088-7

Vancouver

Zografos LT, Konstantoulaki A, Klein C, Vatakis A, Smyrnis N. Audiovisual integration of speech: evidence for increased accuracy in “talk” versus “listen” condition. Experimental Brain Research. 2025. doi:10.1007/s00221-025-07088-7

BibTeX
@article{Zografos2025,
  author = {Zografos, Lefteris Themelis and Konstantoulaki, Anna and Klein, Christoph and Vatakis, Argiro and Smyrnis, Nikolaos},
  title = {Audiovisual integration of speech: evidence for increased accuracy in “talk” versus “listen” condition},
  journal = {Experimental Brain Research},
  year = {2025},
  doi = {10.1007/s00221-025-07088-7}
}
Kostenlos starten →