EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Beyond words: The impact of static and animated faces as visual cues on memory performance and listening effort during two-talker conversations

Chinthusa Mohanathasan, Plamenna B Koleva, Jonathan Ehret, Andrea Bönsch, Janina Fels, Torsten W Kuhlen, Sabine J Schlittmeier

Acta Psychologica · 2026

DOI: 10.1016/j.actpsy.2026.106295 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Acta Psychologica, 2026. Verfasst von Chinthusa Mohanathasan und 6 weiteren Autor:innen. Beteiligte Einrichtung: Work and Engineering Psychology, RWTH Aachen University, Jaegerstraße 17-19, 52066 Aachen, Germany. Electronic address: chinthusa.mohanathasan@psych.…. Hauptthemen laut MEDLINE: Cues, Memory, Short-Term, Speech Perception, Attention. Die Arbeit nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deutsche Forschungsgemeinschaft, HEAD-Genuit Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Listening to a conversation between two talkers and recalling the information is a common goal in verbal communication. However, cognitive-psychological experiments on short-term memory performance often rely on rather simple stimulus material, such as unrelated word lists or isolated sentences. The present study uniquely incorporated running speech, such as listening to a two-talker conversation, to investigate whether talker-related visual cues enhance short-term memory performance and reduce listening effort in non-noisy listening settings. In two equivalent dual-task experiments, participants listened to interrelated sentences spoken by two alternating talkers from two spatial positions, with talker-related visual cues presented as either static faces (Experiment 1, n = 30) or animated faces with lip sync (Experiment 2, n = 28). After each conversation, participants answered content-related questions as a measure of short-term memory (via the Heard Text Recall task). In parallel to listening, they performed a vibrotactile pattern recognition task to assess listening effort. Visual cue conditions (static or animated faces) were compared within-subject to a baseline condition without faces. To account for inter-individual variability, we measured and included individual working memory capacity, processing speed, and attentional functions as cognitive covariates. After controlling for these covariates, results indicated that neither static nor animated faces improved short-term memory performance for conversational content. However, static faces reduced listening effort, whereas animated faces increased it, as indicated by secondary task RTs. Participants' subjective ratings mirrored these behavioral results. Furthermore, working memory capacity was associated with short-term memory performance, and processing speed was associated with listening effort, the latter reflected in performance on the vibrotactile secondary task. In conclusion, this study demonstrates that visual cues influence listening effort and that individual differences in working memory and processing speed help explain variability in task performance, even in optimal listening conditions. • Static and animated faces were tested for effects on short-term memory and listening effort in two-talker conversations. • Working memory, processing speed, and attention were included as covariates. • Static and animated faces did not affect short-term memory when controlling for the three covariates. • Static faces reduced listening effort compared to conditions without faces after accounting for the three covariates. • Animated faces increased listening effort compared to conditions without faces after controlling for the three covariates.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CuesMemory, Short-TermSpeech PerceptionAttentionFacial RecognitionPattern Recognition, VisualHumansFemaleMaleAdultYoung AdultDual-Task TestsProcessing SpeedAdolescentMental Recall

Stichwörter der Autor:innen

Animated facesConversationsListeningListening effortRunning speechShort-term memorySpatial locationStatic facesVisual cues

Autor:innen und Institutionen

  • Work and Engineering Psychology, RWTH Aachen University, Jaegerstraße 17-19, 52066 Aachen, Germany. Electronic address: chinthusa.mohanathasan@psych.rwth-aachen.de.
  • Work and Engineering Psychology, RWTH Aachen University, Jaegerstraße 17-19, 52066 Aachen, Germany.
  • Visual Computing Institute, RWTH Aachen University, Kopernikusstraße 6, 52074 Aachen, Germany.
  • Institute for Hearing Technology and Acoustics, RWTH Aachen University, Kopernikusstraße 5, 52074 Aachen, Germany.

Förderung

  • Deutsche Forschungsgemeinschaft
  • HEAD-Genuit Foundation

Zitieren

APA

Mohanathasan, C., Koleva, P. B., Ehret, J., Bönsch, A., Fels, J., Kuhlen, T. W., & Schlittmeier, S. J. (2026). Beyond words: The impact of static and animated faces as visual cues on memory performance and listening effort during two-talker conversations. Acta Psychologica. https://doi.org/10.1016/j.actpsy.2026.106295

Vancouver

Mohanathasan C, Koleva PB, Ehret J, Bönsch A, Fels J, Kuhlen TW, et al. Beyond words: The impact of static and animated faces as visual cues on memory performance and listening effort during two-talker conversations. Acta Psychologica. 2026. doi:10.1016/j.actpsy.2026.106295

BibTeX
@article{Mohanathasan2026,
  author = {Mohanathasan, Chinthusa and Koleva, Plamenna B and Ehret, Jonathan and Bönsch, Andrea and Fels, Janina and Kuhlen, Torsten W and Schlittmeier, Sabine J},
  title = {Beyond words: The impact of static and animated faces as visual cues on memory performance and listening effort during two-talker conversations},
  journal = {Acta Psychologica},
  year = {2026},
  doi = {10.1016/j.actpsy.2026.106295}
}
Kostenlos starten →