EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Performance in an Audiovisual Selective Attention Task Using Speech-Like Stimuli Depends on the Talker Identities, But Not Temporal Coherence

Madeline S Cappelloni iD, Vincent S Mateo, Ross K Maddox iD

Trends in Hearing · 2023

DOI: 10.1177/23312165231207235 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Trends in Hearing, 2023. Verfasst von Madeline S Cappelloni und 2 weiteren Autor:innen. Beteiligte Einrichtung: Biomedical Engineering, University of Rochester, Rochester, NY, USA. Hauptthemen laut MEDLINE: Speech, Speech Perception. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NEI NIH HHS, NIDCD NIH HHS, National Institute on Deafness and Other Communication Disorders.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Audiovisual integration of speech can benefit the listener by not only improving comprehension of what a talker is saying but also helping a listener select a particular talker's voice from a mixture of sounds. Binding, an early integration of auditory and visual streams that helps an observer allocate attention to a combined audiovisual object, is likely involved in processing audiovisual speech. Although temporal coherence of stimulus features across sensory modalities has been implicated as an important cue for non-speech stimuli (Maddox et al., 2015), the specific cues that drive binding in speech are not fully understood due to the challenges of studying binding in natural stimuli. Here we used speech-like artificial stimuli that allowed us to isolate three potential contributors to binding: temporal coherence (are the face and the voice changing synchronously?), articulatory correspondence (do visual faces represent the correct phones?), and talker congruence (do the face and voice come from the same person?). In a trio of experiments, we examined the relative contributions of each of these cues. Normal hearing listeners performed a dual task in which they were instructed to respond to events in a target auditory stream while ignoring events in a distractor auditory stream (auditory discrimination) and detecting flashes in a visual stream (visual detection). We found that viewing the face of a talker who matched the attended voice (i.e., talker congruence) offered a performance benefit. We found no effect of temporal coherence on performance in this task, prompting an important recontextualization of previous findings.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SpeechSpeech PerceptionHumansAuditory PerceptionCuesSoundVisual Perception

Stichwörter der Autor:innen

audiovisual integrationbindingselective attentionspeech-like stimuli

Autor:innen und Institutionen

  • Biomedical Engineering, University of Rochester, Rochester, NY, USA.
  • Center for Visual Science, University of Rochester, Rochester, NY, USA.
  • Del Monte Institute for Neuroscience, University of Rochester, Rochester, NY, USA.
  • Audio and Music Engineering, University of Rochester, Rochester, NY, USA.
  • Neuroscience, University of Rochester, Rochester, NY, USA.

ORCID-Profile: Madeline S Cappelloni, Ross K Maddox

Förderung

  • NEI NIH HHS
  • NIDCD NIH HHS
  • National Institute on Deafness and Other Communication Disorders
  • Center for Visual Science, University of Rochester

Zitieren

APA

Cappelloni, M. S., Mateo, V. S., & Maddox, R. K. (2023). Performance in an Audiovisual Selective Attention Task Using Speech-Like Stimuli Depends on the Talker Identities, But Not Temporal Coherence. Trends in Hearing. https://doi.org/10.1177/23312165231207235

Vancouver

Cappelloni MS, Mateo VS, Maddox RK. Performance in an Audiovisual Selective Attention Task Using Speech-Like Stimuli Depends on the Talker Identities, But Not Temporal Coherence. Trends in Hearing. 2023. doi:10.1177/23312165231207235

BibTeX
@article{Cappelloni2023,
  author = {Cappelloni, Madeline S and Mateo, Vincent S and Maddox, Ross K},
  title = {Performance in an Audiovisual Selective Attention Task Using Speech-Like Stimuli Depends on the Talker Identities, But Not Temporal Coherence},
  journal = {Trends in Hearing},
  year = {2023},
  doi = {10.1177/23312165231207235}
}
Kostenlos starten →