EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Dopamine transients encode reward prediction errors independent of learning rates

Andrew Mah, Carla E M Golden, Christine M Constantinople

Cell Reports · 2024

DOI: 10.1016/j.celrep.2024.114840 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cell Reports, 2024. Verfasst von Andrew Mah und 2 weiteren Autor:innen. Beteiligte Einrichtung: Center for Neural Science, New York University, New York, NY, USA. Hauptthemen laut MEDLINE: Dopamine, Reward, Nucleus Accumbens, Learning. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIMH NIH HHS, NIDA NIH HHS, Simons Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Biological accounts of reinforcement learning posit that dopamine encodes reward prediction errors (RPEs), which are multiplied by a learning rate to update state or action values. These values are thought to be represented by corticostriatal synaptic weights, which are updated by dopamine-dependent plasticity. This suggests that dopamine release reflects the product of the learning rate and RPE. Here, we characterize dopamine encoding of learning rates in the nucleus accumbens core (NAcc) in a volatile environment. Using a task with semi-observable states offering different rewards, we find that rats adjust how quickly they initiate trials across states using RPEs. Computational modeling and behavioral analyses show that learning rates are higher following state transitions and scale with trial-by-trial changes in beliefs about hidden states, approximating normative Bayesian strategies. Notably, dopamine release in the NAcc encodes RPEs independent of learning rates, suggesting that dopamine-independent mechanisms instantiate dynamic learning rates.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

DopamineRewardNucleus AccumbensLearningAnimalsMaleRatsBayes TheoremRats, Long-EvansRats, Sprague-Dawley

Stichwörter der Autor:innen

CP: Neurosciencechangepoint detectiondopaminedynamic learning ratenucleus accumbens corereinforcement learning

Substanzen

Dopamine

Autor:innen und Institutionen

  • Center for Neural Science, New York University, New York, NY, USA.
  • Center for Neural Science, New York University, New York, NY, USA. Electronic address: constantinople@nyu.edu.

Förderung

  • NIMH NIH HHS
  • NIDA NIH HHS
  • Simons Foundation
  • National Institutes of Health
  • Alfred P. Sloan Foundation
  • Esther A & Joseph Klingenstein Fund
  • National Institute of Mental Health
  • National Science Foundation

Zitieren

APA

Mah, A., Golden, C. E. M., & Constantinople, C. M. (2024). Dopamine transients encode reward prediction errors independent of learning rates. Cell Reports. https://doi.org/10.1016/j.celrep.2024.114840

Vancouver

Mah A, Golden CEM, Constantinople CM. Dopamine transients encode reward prediction errors independent of learning rates. Cell Reports. 2024. doi:10.1016/j.celrep.2024.114840

BibTeX
@article{Mah2024,
  author = {Mah, Andrew and Golden, Carla E M and Constantinople, Christine M},
  title = {Dopamine transients encode reward prediction errors independent of learning rates},
  journal = {Cell Reports},
  year = {2024},
  doi = {10.1016/j.celrep.2024.114840}
}
Kostenlos starten →