EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Emotional Recognition Under Multimodal Conflict: A Gaze-Based Response Task

Alessandro De Santis, Giusi Antonia Toto, Martina Rossi, Laura D’Amico, Pierpaolo Limone

Psychology International · 20.04.2026 · 8 (2) · 26

DOI: 10.3390/psycholint8020026 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychology International, online erschienen am 20.04.2026. Verfasst von Alessandro De Santis und 4 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotional recognition relies on the integration of multiple affective cues. In everyday contexts, however, facial expressions, vocal prosody, and semantic content may convey incongruent emotional information, generating emotional conflict and increasing cognitive demands. The present study examined how multimodal emotional conflict affects emotion recognition during video viewing, focusing on short videos in which a single actor simultaneously conveyed incongruent emotional cues across facial, vocal, and semantic channels. Forty-seven undergraduate students completed a gaze-based response task in which, after each short video, they provided a single judgment of the overall emotion conveyed by the stimulus. The videos depicted either congruent or incongruent combinations of semantic content, facial expressions, and vocal prosody across six basic emotions and a neutral condition. Data were analyzed using repeated-measures ANOVAs and generalized linear mixed-effects models. Accuracy was consistently higher for congruent than incongruent stimuli across all domains, indicating a robust emotional interference effect. Critically, the magnitude of this effect differed by domain. Semantic content showed the largest performance reduction under incongruence, followed by facial expression and vocal prosody. Mixed-effects models confirmed these effects while accounting for participant- and item-level variability and revealed a significant Congruency × Domain interaction. In a gaze-based response task requiring a single overall emotion judgment, emotional conflict disrupted recognition in a domain-specific manner, with semantic information being particularly vulnerable to multimodal interference.

Zitieren

APA

Santis, A. D., Toto, G. A., Rossi, M., D’Amico, L., & Limone, P. (2026). Emotional Recognition Under Multimodal Conflict: A Gaze-Based Response Task. Psychology International, 8(2), 26. https://doi.org/10.3390/psycholint8020026

Vancouver

Santis AD, Toto GA, Rossi M, D’Amico L, Limone P. Emotional Recognition Under Multimodal Conflict: A Gaze-Based Response Task. Psychology International. 2026;8(2):26. doi:10.3390/psycholint8020026

BibTeX
@article{Santis2026,
  author = {Santis, Alessandro De and Toto, Giusi Antonia and Rossi, Martina and D’Amico, Laura and Limone, Pierpaolo},
  title = {Emotional Recognition Under Multimodal Conflict: A Gaze-Based Response Task},
  journal = {Psychology International},
  year = {2026},
  volume = {8},
  number = {2},
  pages = {26},
  doi = {10.3390/psycholint8020026}
}
Kostenlos starten →