Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum
eLife · 2026
DOI: 10.7554/elife.106032 ↗Kurz gefasst
Fachartikel in der Zeitschrift eLife, 2026. Verfasst von Bruno Miranda und 5 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Neurology, Department of Clinical and Movement Neurosciences, University College London, London, United Kingdom. Hauptthemen laut MEDLINE: Prefrontal Cortex, Corpus Striatum, Neurons, Reinforcement, Psychology. Die Arbeit nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust, Fundação para a Ciência e a Tecnologia, Santa Casa da Misericórdia de Lisboa.
Abstract (Originalsprache)
Animals integrate knowledge about how the state of the environment evolves to choose actions that maximise reward. Such goal-directed behaviour – or model-based (MB) reinforcement learning (RL) – can flexibly adapt choice to changes, being thus distinct from simpler habitual – or model-free (MF) RL – strategies. Previous inactivation and neuroimaging work implicates prefrontal cortex (PFC) and the caudate striatal region in MB-RL; however, details are scarce about its implementation at the single-neuron level. Here, we recorded from two PFC regions – the dorsal anterior cingulate cortex (ACC) and dorsolateral PFC (DLPFC), and two striatal regions, caudate and putamen – while two rhesus macaques performed a sequential decision-making (two-step) task in which MB-RL involves knowledge about the statistics of reward and state transitions. All four regions, but particularly the ACC, encoded the rewards received and tracked the probabilistic state transitions that occurred. However, ACC (and to a lesser extent caudate) encoded the key variables of the task – namely the interaction between reward, transition, and choice – which underlies MB decision-making. ACC and caudate neurons also encoded MB-derived estimates of choice values. Moreover, caudate value estimates of the choice options flipped when a rare transition occurred, demonstrating value update based on structural knowledge of the task. The striatal regions were unique (relative to PFC) in encoding the current and previous rewards with opposing polarities, reminiscent of dopaminergic neurons, and indicative of an MF prediction error. Our findings provide a deeper understanding of selective and temporally dissociable neural mechanisms underlying goal-directed behaviour.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Neurology, Department of Clinical and Movement Neurosciences, University College London, London, United Kingdom.
- Instituto de Fisiologia, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal.
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom.
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, FMRIB, John Radcliffe Hospital, Oxford, United Kingdom.
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour College, University College London, London, United Kingdom.
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany.
ORCID-Profile: Bruno Miranda, James L Butler, Timothy E J Behrens, Peter Dayan, Steven W Kennerley
Förderung
- Wellcome Trust
- Fundação para a Ciência e a Tecnologia
- Santa Casa da Misericórdia de Lisboa
- Gatsby Charitable Foundation
- Biotechnology and Biological Sciences Research Council
- Astor Foundation
- Jean Francois and Marie-Laure de Clermont Tonerre Foundation
- Max Planck Society
Zitieren
APA
Miranda, B., Butler, J. L., Malalasekera, W. M. N., Behrens, T. E. J., Dayan, P., & Kennerley, S. W. (2026). Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum. eLife. https://doi.org/10.7554/elife.106032
Vancouver
Miranda B, Butler JL, Malalasekera WMN, Behrens TEJ, Dayan P, Kennerley SW. Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum. eLife. 2026. doi:10.7554/elife.106032
BibTeX
@article{Miranda2026,
author = {Miranda, Bruno and Butler, James L and Malalasekera, W M Nishantha and Behrens, Timothy E J and Dayan, Peter and Kennerley, Steven W},
title = {Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum},
journal = {eLife},
year = {2026},
doi = {10.7554/elife.106032}
}
EUVIMED