EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Potential for Reinforcement Learning in the Cerebellum

Richard W Prager, Richard Apps

Neural Computation · 17.03.2026 · 38 (4) · 499-537

DOI: 10.1162/neco.a.1507 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neural Computation, online erschienen am 17.03.2026. Verfasst von Richard W Prager und 1 weiteren Autor:innen. Beteiligte Einrichtung: University of Cambridge, Cambridge CB2 1PZ, UK rwp12@cam.ac.uk. Hauptthemen laut MEDLINE: Cerebellum, Reinforcement Machine Learning, Reinforcement, Psychology, Models, Neurological. Die Arbeit nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Marie Skłodowska-Curie.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article explores how simple reinforcement learning algorithms might be implemented by the anatomy of the cerebellum. In doing this, we highlight which anatomical and physiological details are most important for assessing algorithmic fit, and we discuss which algorithm components are easiest to accommodate in a neural system. We describe hypothetical cerebellar implementations of four reinforcement learning algorithms and discuss the anatomical plausibility of the various components required. We show how one of the algorithms can learn to generate short sequences of actions without continuous information on the resulting changes to the environment. We finish with simulations that illustrate the way that the algorithms learn to solve the problem of balancing an inverted pendulum, commonly known as the cart-pole problem. We highlight two physiological features: reward signals and combining information across time, that indicate that some sort of reinforcement learning adaptation may be taking place. We also describe why the commonly used algorithmic feature, an eligibility trace, presents particular problems to implement in known neural anatomy.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CerebellumReinforcement Machine LearningReinforcement, PsychologyModels, NeurologicalLearningAnimalsHumansAlgorithmsComputer Simulation

Autor:innen und Institutionen

  • University of Cambridge, Cambridge CB2 1PZ, UK rwp12@cam.ac.uk.
  • University of Bristol, BS8 1QU, UK R.Apps@bristol.ac.uk.

Förderung

  • Marie Skłodowska-Curie

Zitieren

APA

Prager, R. W., & Apps, R. (2026). Potential for Reinforcement Learning in the Cerebellum. Neural Computation, 38(4), 499-537. https://doi.org/10.1162/neco.a.1507

Vancouver

Prager RW, Apps R. Potential for Reinforcement Learning in the Cerebellum. Neural Computation. 2026;38(4):499-537. doi:10.1162/neco.a.1507

BibTeX
@article{Prager2026,
  author = {Prager, Richard W and Apps, Richard},
  title = {Potential for Reinforcement Learning in the Cerebellum},
  journal = {Neural Computation},
  year = {2026},
  volume = {38},
  number = {4},
  pages = {499--537},
  doi = {10.1162/neco.a.1507}
}
Kostenlos starten →