Influence of surprise on reinforcement learning in younger and older adults
PLOS Computational Biology · 2024
DOI: 10.1371/journal.pcbi.1012331 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, 2024. Verfasst von Christoph Koch und 3 weiteren Autor:innen. Beteiligte Einrichtung: Max Planck Institute for Human Development, Berlin, Germany. Hauptthemen laut MEDLINE: Reinforcement, Psychology, Aging. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Federal Government of Germany and the State of Hamburg as part of the Excellence Initiative, Independent Max Planck Research Group, Max-Planck-Gesellschaft.
Themen: Gerontologische Pflege
Abstract (Originalsprache)
Surprise is a key component of many learning experiences, and yet its precise computational role, and how it changes with age, remain debated. One major challenge is that surprise often occurs jointly with other variables, such as uncertainty and outcome probability. To assess how humans learn from surprising events, and whether aging affects this process, we studied choices while participants learned from bandits with either Gaussian or bi-modal outcome distributions, which decoupled outcome probability, uncertainty, and surprise. A total of 102 participants (51 older, aged 50–73; 51 younger, 19–30 years) chose between three bandits, one of which had a bimodal outcome distribution. Behavioral analyses showed that both age-groups learned the average of the bimodal bandit less well. A trial-by-trial analysis indicated that participants performed choice reversals immediately following large absolute prediction errors, consistent with heightened sensitivity to surprise. This effect was stronger in older adults. Computational models indicated that learning rates in younger as well as older adults were influenced by surprise, rather than uncertainty, but also suggested large interindividual variability in the process underlying learning in our task. Our work bridges between behavioral economics research that has focused on how outcomes with low probability affect choice in older adults, and reinforcement learning work that has investigated age differences in the effects of uncertainty and suggests that older adults overly adapt to surprising events, even when accounting for probability and uncertainty effects.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Max Planck Institute for Human Development, Berlin, Germany.
- Institute of Psychology, Universität Hamburg, Hamburg, Germany.
- Max Planck UCL Centre for Computational Psychiatry and Aging Research, Berlin, Germany, and London, United Kingdom.
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany.
ORCID-Profile: Ondrej Zika, Rasmus Bruckner, Nicolas W Schuck
Förderung
- Federal Government of Germany and the State of Hamburg as part of the Excellence Initiative
- Independent Max Planck Research Group
- Max-Planck-Gesellschaft
- Deutsche Forschungsgemeinschaft
Zitieren
APA
Koch, C., Zika, O., Bruckner, R., & Schuck, N. W. (2024). Influence of surprise on reinforcement learning in younger and older adults. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1012331
Vancouver
Koch C, Zika O, Bruckner R, Schuck NW. Influence of surprise on reinforcement learning in younger and older adults. PLOS Computational Biology. 2024. doi:10.1371/journal.pcbi.1012331
BibTeX
@article{Koch2024,
author = {Koch, Christoph and Zika, Ondrej and Bruckner, Rasmus and Schuck, Nicolas W},
title = {Influence of surprise on reinforcement learning in younger and older adults},
journal = {PLOS Computational Biology},
year = {2024},
doi = {10.1371/journal.pcbi.1012331}
}
EUVIMED