Understanding Audiovisual Affective Processing: Behavioral Effects and Neural Underpinnings
Social Cognitive and Affective Neuroscience · 04.11.2026
DOI: 10.1093/scan/nsag090 ↗Kurz gefasst
Fachartikel in der Zeitschrift Social Cognitive and Affective Neuroscience, online erschienen am 04.11.2026. Verfasst von Chuanji Gao und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Psychology, Nanjing Normal University, Nanjing, China. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Emotional signals are typically conveyed jointly through vision and audition. This article reviews behavioral, electrophysiological, and neuroimaging evidence on audiovisual affective processing, addressing what its core effects are, when they unfold, and where they occur in the brain. Congruent audiovisual cues often facilitate emotion recognition, although benefits vary across emotions, tasks, measures, and unimodal comparisons. Audiovisual input can also shape affective appraisals and subjective emotional experience. Modality dominance is context-dependent, varying with cue reliability and the affective dimension judged. Cross-modal influences can persist when one modality is task-irrelevant, suggesting limited goal dependence. Electrophysiological findings reveal audiovisual affective interactions at both early and later stages of neural processing. Neuroimaging work implicates posterior superior temporal cortex (pSTC) within a distributed network of sensory, subcortical, and frontal regions. Building on this evidence, we consider Anderson's information integration theory as a computational framework for characterizing modality-related and value-dependent contributions to affective judgments. We propose a hypothesis-generating dual-pathway framework predicting that reliability-related changes in cue influence will covary with sensory-pSTC interactions, whereas value-dependent changes will additionally involve amygdala and prefrontal systems. These hypotheses concern relative rather than exclusive network contributions and require direct testing through independent manipulations of cue reliability and affective value.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Psychology, Nanjing Normal University, Nanjing, China.
- Taizhou Fifth People's Hospital.
- Adolescent Education and Intelligence Support Lab of Nanjing Normal University, Laboratory of Philosophy and Social Sciences at Universities in Jiangsu Province, Nanjing, China.
- Department of Psychology, University of South Carolina, Columbia 29208, USA.
Zitieren
APA
Gao, C., Green, J. J., Shinkareva, S. V., Yan, R., & Xu, Z. (2026). Understanding Audiovisual Affective Processing: Behavioral Effects and Neural Underpinnings. Social Cognitive and Affective Neuroscience. https://doi.org/10.1093/scan/nsag090
Vancouver
Gao C, Green JJ, Shinkareva SV, Yan R, Xu Z. Understanding Audiovisual Affective Processing: Behavioral Effects and Neural Underpinnings. Social Cognitive and Affective Neuroscience. 2026. doi:10.1093/scan/nsag090
BibTeX
@article{Gao2026,
author = {Gao, Chuanji and Green, Jessica J and Shinkareva, Svetlana V and Yan, Runfeng and Xu, Zikai},
title = {Understanding Audiovisual Affective Processing: Behavioral Effects and Neural Underpinnings},
journal = {Social Cognitive and Affective Neuroscience},
year = {2026},
doi = {10.1093/scan/nsag090}
}
EUVIMED