EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Learning predictive cognitive maps with spiking neurons during behavior and replays

Jacopo Bono iD, Sara Zannone iD, Victor Pedrosa, Claudia Clopath iD

eLife · 2023

DOI: 10.7554/elife.80671 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eLife, 2023. Verfasst von Jacopo Bono und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Bioengineering, Imperial College London, London, United Kingdom. Hauptthemen laut MEDLINE: Learning, Neurons. Die Arbeit wurde bisher 42-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust, Engineering and Physical Sciences Research Council, Simons Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The hippocampus has been proposed to encode environments using a representation that contains predictive information about likely future states, called the successor representation. However, it is not clear how such a representation could be learned in the hippocampal circuit. Here, we propose a plasticity rule that can learn this predictive map of the environment using a spiking neural network. We connect this biologically plausible plasticity rule to reinforcement learning, mathematically and numerically showing that it implements the TD-lambda algorithm. By spanning these different levels, we show how our framework naturally encompasses behavioral activity and replays, smoothly moving from rate to temporal coding, and allows learning over behavioral timescales with a plasticity rule acting on a timescale of milliseconds. We discuss how biological parameters such as dwelling times at states, neuronal firing rates and neuromodulation relate to the delay discounting parameter of the TD algorithm, and how they influence the learned representation. We also find that, in agreement with psychological studies and contrary to reinforcement learning theory, the discount factor decreases hyperbolically with time. Finally, our framework suggests a role for replays, in both aiding learning in novel environments and finding shortcut trajectories that were not experienced during behavior, in agreement with experimental data.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LearningNeuronsReinforcement, PsychologyBehavior TherapyCognitionModels, NeurologicalAction PotentialsNeuronal Plasticity

Stichwörter der Autor:innen

computational biologyhippocampusmodellingmousepredictivesuccessor representationsystems biology

Autor:innen und Institutionen

  • Department of Bioengineering, Imperial College London, London, United Kingdom.

ORCID-Profile: Jacopo Bono, Sara Zannone, Claudia Clopath

Förderung

  • Wellcome Trust
  • Engineering and Physical Sciences Research Council
  • Simons Foundation

Zitieren

APA

Bono, J., Zannone, S., Pedrosa, V., & Clopath, C. (2023). Learning predictive cognitive maps with spiking neurons during behavior and replays. eLife. https://doi.org/10.7554/elife.80671

Vancouver

Bono J, Zannone S, Pedrosa V, Clopath C. Learning predictive cognitive maps with spiking neurons during behavior and replays. eLife. 2023. doi:10.7554/elife.80671

BibTeX
@article{Bono2023,
  author = {Bono, Jacopo and Zannone, Sara and Pedrosa, Victor and Clopath, Claudia},
  title = {Learning predictive cognitive maps with spiking neurons during behavior and replays},
  journal = {eLife},
  year = {2023},
  doi = {10.7554/elife.80671}
}
Kostenlos starten →