A dopamine mechanism for reward maximization
Proceedings of the National Academy of Sciences · 14.05.2024 · 121 (20)
DOI: 10.1073/pnas.2316658121 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 08.05.2024. Verfasst von Wolfram Schultz. Beteiligte Einrichtung: Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom. Hauptthemen laut MEDLINE: Reward, Dopamine, Dopaminergic Neurons. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 97 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust.
Abstract (Originalsprache)
Individual survival and evolutionary selection require biological organisms to maximize reward. Economic choice theories define the necessary and sufficient conditions, and neuronal signals of decision variables provide mechanistic explanations. Reinforcement learning (RL) formalisms use predictions, actions, and policies to maximize reward. Midbrain dopamine neurons code reward prediction errors (RPE) of subjective reward value suitable for RL. Electrical and optogenetic self-stimulation experiments demonstrate that monkeys and rodents repeat behaviors that result in dopamine excitation. Dopamine excitations reflect positive RPEs that increase reward predictions via RL; against increasing predictions, obtaining similar dopamine RPE signals again requires better rewards than before. The positive RPEs drive predictions higher again and thus advance a recursive reward-RPE-prediction iteration toward better and better rewards. Agents also avoid dopamine inhibitions that lower reward prediction via RL, which allows smaller rewards than before to elicit positive dopamine RPE signals and resume the iteration toward better rewards. In this way, dopamine RPE signals serve a causal mechanism that attracts agents via RL to the best rewards. The mechanism improves daily life and benefits evolutionary selection but may also induce restlessness and greed.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom.
ORCID-Profile: Wolfram Schultz
Förderung
- Wellcome Trust
Zitieren
APA
Schultz, W. (2024). A dopamine mechanism for reward maximization. Proceedings of the National Academy of Sciences, 121(20). https://doi.org/10.1073/pnas.2316658121
Vancouver
Schultz W. A dopamine mechanism for reward maximization. Proceedings of the National Academy of Sciences. 2024;121(20). doi:10.1073/pnas.2316658121
BibTeX
@article{Schultz2024,
author = {Schultz, Wolfram},
title = {A dopamine mechanism for reward maximization},
journal = {Proceedings of the National Academy of Sciences},
year = {2024},
volume = {121},
number = {20},
doi = {10.1073/pnas.2316658121}
}
EUVIMED