Memory for multimodal picture-sound items: Influences of congruency, identifiability and cognitive ageing
Acta Psychologica · 2026-06 · 266 · 106876
DOI: 10.1016/j.actpsy.2026.106876 ↗Kurz gefasst
Fachartikel in der Zeitschrift Acta Psychologica, 2026-06. Verfasst von Stephen P Badham und 5 weiteren Autor:innen. Beteiligte Einrichtung: NTU Psychology, Nottingham Trent University, Nottingham, UK. Electronic address: stephen.badham@ntu.ac.uk. Hauptthemen laut MEDLINE: Auditory Perception, Cognitive Aging, Mental Recall, Visual Perception. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: UK Research and Innovation Economic and Social Research Council.
Abstract (Originalsprache)
Multimodal perception can often evoke performance that is greater than the sum of its unimodal parts in cognitive tasks. For example, choice reaction time research has found responses to multimodal stimuli that are faster than could be explained by responses to its individual unimodal components. This has led to a growth in multimodal perceptual research to explain behavioural observations, but less is known about multimodal influences on more cognitively demanding tasks such as semantic activation and memory. Across 3 well-powered pre-registered memory experiments (total n = 792), this study tested if multimodal encoding could reduce perceptual demands, evoke semantic processing, and encourage episodic recollection. In Experiment 1 the presence of congruent visual information aided later unimodal auditory retrieval (e.g., a dog picture and a barking sound), but multimodal manipulations had similar effects across young and older adults. Experiment 2 equated auditory only and visual only memory for picture-sound items by utilising blurring of the visual pictures, generating a novel shared stimulus set. Here there was no benefit to multimodal encoding, and identifiability of a given stimulus was more strongly related to memory following multimodal encoding than memory following unimodal encoding. Experiment 3 utilised the remember-know paradigm and found no specific multimodal encoding effects on episodic remembering, but did find that item identifiability was more strongly linked to recollection than to familiarity. Our data highlight how multimodal processing is nuanced and supports a general need for multimodal research to explain wholistic sensory processing.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- NTU Psychology, Nottingham Trent University, Nottingham, UK. Electronic address: stephen.badham@ntu.ac.uk.
- NTU Psychology, Nottingham Trent University, Nottingham, UK.
- School of Psychology, University of Nottingham, Nottingham, UK.
- UK School ofPsychology & Vision Sciences, University of Leicester, Leicester, UK.
- Hearing Sciences, Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK; National Institute for Health and Care Research (NIHR), Nottingham Biomedical Research Centre, No…
Förderung
- UK Research and Innovation Economic and Social Research Council
Zitieren
APA
Badham, S. P., Atkin, C., Allen, H. A., Stacey, J. E., Henshaw, H., & Roberts, K. L. (2026). Memory for multimodal picture-sound items: Influences of congruency, identifiability and cognitive ageing. Acta Psychologica, 266, 106876. https://doi.org/10.1016/j.actpsy.2026.106876
Vancouver
Badham SP, Atkin C, Allen HA, Stacey JE, Henshaw H, Roberts KL. Memory for multimodal picture-sound items: Influences of congruency, identifiability and cognitive ageing. Acta Psychologica. 2026;266:106876. doi:10.1016/j.actpsy.2026.106876
BibTeX
@article{Badham2026,
author = {Badham, Stephen P and Atkin, Christopher and Allen, Harriet A and Stacey, Jemaine E and Henshaw, Helen and Roberts, Katherine L},
title = {Memory for multimodal picture-sound items: Influences of congruency, identifiability and cognitive ageing},
journal = {Acta Psychologica},
year = {2026},
volume = {266},
pages = {106876},
doi = {10.1016/j.actpsy.2026.106876}
}
EUVIMED