EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Understanding Audiovisual Affective Processing: Behavioral Effects and Neural Underpinnings

Chuanji Gao, Jessica J Green, Svetlana V Shinkareva, Runfeng Yan, Zikai Xu

Social Cognitive and Affective Neuroscience · 04.11.2026

DOI: 10.1093/scan/nsag090 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Social Cognitive and Affective Neuroscience, online erschienen am 04.11.2026. Verfasst von Chuanji Gao und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Psychology, Nanjing Normal University, Nanjing, China. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotional signals are typically conveyed jointly through vision and audition. This article reviews behavioral, electrophysiological, and neuroimaging evidence on audiovisual affective processing, addressing what its core effects are, when they unfold, and where they occur in the brain. Congruent audiovisual cues often facilitate emotion recognition, although benefits vary across emotions, tasks, measures, and unimodal comparisons. Audiovisual input can also shape affective appraisals and subjective emotional experience. Modality dominance is context-dependent, varying with cue reliability and the affective dimension judged. Cross-modal influences can persist when one modality is task-irrelevant, suggesting limited goal dependence. Electrophysiological findings reveal audiovisual affective interactions at both early and later stages of neural processing. Neuroimaging work implicates posterior superior temporal cortex (pSTC) within a distributed network of sensory, subcortical, and frontal regions. Building on this evidence, we consider Anderson's information integration theory as a computational framework for characterizing modality-related and value-dependent contributions to affective judgments. We propose a hypothesis-generating dual-pathway framework predicting that reliability-related changes in cue influence will covary with sensory-pSTC interactions, whereas value-dependent changes will additionally involve amygdala and prefrontal systems. These hypotheses concern relative rather than exclusive network contributions and require direct testing through independent manipulations of cue reliability and affective value.

Schlagwörter

Stichwörter der Autor:innen

Affective ProcessingAudiovisualEmotionInformation Integration

Autor:innen und Institutionen

  • School of Psychology, Nanjing Normal University, Nanjing, China.
  • Taizhou Fifth People's Hospital.
  • Adolescent Education and Intelligence Support Lab of Nanjing Normal University, Laboratory of Philosophy and Social Sciences at Universities in Jiangsu Province, Nanjing, China.
  • Department of Psychology, University of South Carolina, Columbia 29208, USA.

Zitieren

APA

Gao, C., Green, J. J., Shinkareva, S. V., Yan, R., & Xu, Z. (2026). Understanding Audiovisual Affective Processing: Behavioral Effects and Neural Underpinnings. Social Cognitive and Affective Neuroscience. https://doi.org/10.1093/scan/nsag090

Vancouver

Gao C, Green JJ, Shinkareva SV, Yan R, Xu Z. Understanding Audiovisual Affective Processing: Behavioral Effects and Neural Underpinnings. Social Cognitive and Affective Neuroscience. 2026. doi:10.1093/scan/nsag090

BibTeX
@article{Gao2026,
  author = {Gao, Chuanji and Green, Jessica J and Shinkareva, Svetlana V and Yan, Runfeng and Xu, Zikai},
  title = {Understanding Audiovisual Affective Processing: Behavioral Effects and Neural Underpinnings},
  journal = {Social Cognitive and Affective Neuroscience},
  year = {2026},
  doi = {10.1093/scan/nsag090}
}
Kostenlos starten →