Emotional Recognition Under Multimodal Conflict: A Gaze-Based Response Task
Psychology International · 20.04.2026 · 8 (2) · 26
DOI: 10.3390/psycholint8020026 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychology International, online erschienen am 20.04.2026. Verfasst von Alessandro De Santis und 4 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Emotional recognition relies on the integration of multiple affective cues. In everyday contexts, however, facial expressions, vocal prosody, and semantic content may convey incongruent emotional information, generating emotional conflict and increasing cognitive demands. The present study examined how multimodal emotional conflict affects emotion recognition during video viewing, focusing on short videos in which a single actor simultaneously conveyed incongruent emotional cues across facial, vocal, and semantic channels. Forty-seven undergraduate students completed a gaze-based response task in which, after each short video, they provided a single judgment of the overall emotion conveyed by the stimulus. The videos depicted either congruent or incongruent combinations of semantic content, facial expressions, and vocal prosody across six basic emotions and a neutral condition. Data were analyzed using repeated-measures ANOVAs and generalized linear mixed-effects models. Accuracy was consistently higher for congruent than incongruent stimuli across all domains, indicating a robust emotional interference effect. Critically, the magnitude of this effect differed by domain. Semantic content showed the largest performance reduction under incongruence, followed by facial expression and vocal prosody. Mixed-effects models confirmed these effects while accounting for participant- and item-level variability and revealed a significant Congruency × Domain interaction. In a gaze-based response task requiring a single overall emotion judgment, emotional conflict disrupted recognition in a domain-specific manner, with semantic information being particularly vulnerable to multimodal interference.
Zitieren
APA
Santis, A. D., Toto, G. A., Rossi, M., D’Amico, L., & Limone, P. (2026). Emotional Recognition Under Multimodal Conflict: A Gaze-Based Response Task. Psychology International, 8(2), 26. https://doi.org/10.3390/psycholint8020026
Vancouver
Santis AD, Toto GA, Rossi M, D’Amico L, Limone P. Emotional Recognition Under Multimodal Conflict: A Gaze-Based Response Task. Psychology International. 2026;8(2):26. doi:10.3390/psycholint8020026
BibTeX
@article{Santis2026,
author = {Santis, Alessandro De and Toto, Giusi Antonia and Rossi, Martina and D’Amico, Laura and Limone, Pierpaolo},
title = {Emotional Recognition Under Multimodal Conflict: A Gaze-Based Response Task},
journal = {Psychology International},
year = {2026},
volume = {8},
number = {2},
pages = {26},
doi = {10.3390/psycholint8020026}
}
EUVIMED