Dopamine transients encode reward prediction errors independent of learning rates
Cell Reports · 2024
DOI: 10.1016/j.celrep.2024.114840 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cell Reports, 2024. Verfasst von Andrew Mah und 2 weiteren Autor:innen. Beteiligte Einrichtung: Center for Neural Science, New York University, New York, NY, USA. Hauptthemen laut MEDLINE: Dopamine, Reward, Nucleus Accumbens, Learning. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIMH NIH HHS, NIDA NIH HHS, Simons Foundation.
Abstract (Originalsprache)
Biological accounts of reinforcement learning posit that dopamine encodes reward prediction errors (RPEs), which are multiplied by a learning rate to update state or action values. These values are thought to be represented by corticostriatal synaptic weights, which are updated by dopamine-dependent plasticity. This suggests that dopamine release reflects the product of the learning rate and RPE. Here, we characterize dopamine encoding of learning rates in the nucleus accumbens core (NAcc) in a volatile environment. Using a task with semi-observable states offering different rewards, we find that rats adjust how quickly they initiate trials across states using RPEs. Computational modeling and behavioral analyses show that learning rates are higher following state transitions and scale with trial-by-trial changes in beliefs about hidden states, approximating normative Bayesian strategies. Notably, dopamine release in the NAcc encodes RPEs independent of learning rates, suggesting that dopamine-independent mechanisms instantiate dynamic learning rates.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Center for Neural Science, New York University, New York, NY, USA.
- Center for Neural Science, New York University, New York, NY, USA. Electronic address: constantinople@nyu.edu.
Förderung
- NIMH NIH HHS
- NIDA NIH HHS
- Simons Foundation
- National Institutes of Health
- Alfred P. Sloan Foundation
- Esther A & Joseph Klingenstein Fund
- National Institute of Mental Health
- National Science Foundation
Zitieren
APA
Mah, A., Golden, C. E. M., & Constantinople, C. M. (2024). Dopamine transients encode reward prediction errors independent of learning rates. Cell Reports. https://doi.org/10.1016/j.celrep.2024.114840
Vancouver
Mah A, Golden CEM, Constantinople CM. Dopamine transients encode reward prediction errors independent of learning rates. Cell Reports. 2024. doi:10.1016/j.celrep.2024.114840
BibTeX
@article{Mah2024,
author = {Mah, Andrew and Golden, Carla E M and Constantinople, Christine M},
title = {Dopamine transients encode reward prediction errors independent of learning rates},
journal = {Cell Reports},
year = {2024},
doi = {10.1016/j.celrep.2024.114840}
}
EUVIMED