Beyond words: The impact of static and animated faces as visual cues on memory performance and listening effort during two-talker conversations
Acta Psychologica · 2026
DOI: 10.1016/j.actpsy.2026.106295 ↗At a glance
Journal article in Acta Psychologica, 2026. Written by Chinthusa Mohanathasan and 6 co-authors. Institution: Work and Engineering Psychology, RWTH Aachen University, Jaegerstraße 17-19, 52066 Aachen, Germany. Electronic address: chinthusa.mohanathasan@psych.…. Major MEDLINE topics: Cues, Memory, Short-Term, Speech Perception, Attention. 67 references. The full text is freely available (open access, CC BY 4.0). Funded by: Deutsche Forschungsgemeinschaft, HEAD-Genuit Foundation.
Abstract (original language)
Listening to a conversation between two talkers and recalling the information is a common goal in verbal communication. However, cognitive-psychological experiments on short-term memory performance often rely on rather simple stimulus material, such as unrelated word lists or isolated sentences. The present study uniquely incorporated running speech, such as listening to a two-talker conversation, to investigate whether talker-related visual cues enhance short-term memory performance and reduce listening effort in non-noisy listening settings. In two equivalent dual-task experiments, participants listened to interrelated sentences spoken by two alternating talkers from two spatial positions, with talker-related visual cues presented as either static faces (Experiment 1, n = 30) or animated faces with lip sync (Experiment 2, n = 28). After each conversation, participants answered content-related questions as a measure of short-term memory (via the Heard Text Recall task). In parallel to listening, they performed a vibrotactile pattern recognition task to assess listening effort. Visual cue conditions (static or animated faces) were compared within-subject to a baseline condition without faces. To account for inter-individual variability, we measured and included individual working memory capacity, processing speed, and attentional functions as cognitive covariates. After controlling for these covariates, results indicated that neither static nor animated faces improved short-term memory performance for conversational content. However, static faces reduced listening effort, whereas animated faces increased it, as indicated by secondary task RTs. Participants' subjective ratings mirrored these behavioral results. Furthermore, working memory capacity was associated with short-term memory performance, and processing speed was associated with listening effort, the latter reflected in performance on the vibrotactile secondary task. In conclusion, this study demonstrates that visual cues influence listening effort and that individual differences in working memory and processing speed help explain variability in task performance, even in optimal listening conditions. • Static and animated faces were tested for effects on short-term memory and listening effort in two-talker conversations. • Working memory, processing speed, and attention were included as covariates. • Static and animated faces did not affect short-term memory when controlling for the three covariates. • Static faces reduced listening effort compared to conditions without faces after accounting for the three covariates. • Animated faces increased listening effort compared to conditions without faces after controlling for the three covariates.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Work and Engineering Psychology, RWTH Aachen University, Jaegerstraße 17-19, 52066 Aachen, Germany. Electronic address: chinthusa.mohanathasan@psych.rwth-aachen.de.
- Work and Engineering Psychology, RWTH Aachen University, Jaegerstraße 17-19, 52066 Aachen, Germany.
- Visual Computing Institute, RWTH Aachen University, Kopernikusstraße 6, 52074 Aachen, Germany.
- Institute for Hearing Technology and Acoustics, RWTH Aachen University, Kopernikusstraße 5, 52074 Aachen, Germany.
Funding
- Deutsche Forschungsgemeinschaft
- HEAD-Genuit Foundation
Cite
APA
Mohanathasan, C., Koleva, P. B., Ehret, J., Bönsch, A., Fels, J., Kuhlen, T. W., & Schlittmeier, S. J. (2026). Beyond words: The impact of static and animated faces as visual cues on memory performance and listening effort during two-talker conversations. Acta Psychologica. https://doi.org/10.1016/j.actpsy.2026.106295
Vancouver
Mohanathasan C, Koleva PB, Ehret J, Bönsch A, Fels J, Kuhlen TW, et al. Beyond words: The impact of static and animated faces as visual cues on memory performance and listening effort during two-talker conversations. Acta Psychologica. 2026. doi:10.1016/j.actpsy.2026.106295
BibTeX
@article{Mohanathasan2026,
author = {Mohanathasan, Chinthusa and Koleva, Plamenna B and Ehret, Jonathan and Bönsch, Andrea and Fels, Janina and Kuhlen, Torsten W and Schlittmeier, Sabine J},
title = {Beyond words: The impact of static and animated faces as visual cues on memory performance and listening effort during two-talker conversations},
journal = {Acta Psychologica},
year = {2026},
doi = {10.1016/j.actpsy.2026.106295}
}
EUVIMED