EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Rapid learning of predictive maps with STDP and theta phase precession

Tom M George iD, William de Cothi iD, Kimberly L Stachenfeld iD, Caswell Barry iD

eLife · 16.03.2023 · 12

DOI: 10.7554/elife.80663 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eLife, online erschienen am 16.03.2023. Verfasst von Tom M George und 3 weiteren Autor:innen. Beteiligte Einrichtung: Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, United Kingdom. Hauptthemen laut MEDLINE: Neurons, Hippocampus. Die Arbeit wurde bisher 65-mal zitiert (Crossref) und nennt 90 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The predictive map hypothesis is a promising candidate principle for hippocampal function. A favoured formalisation of this hypothesis, called the successor representation, proposes that each place cell encodes the expected state occupancy of its target location in the near future. This predictive framework is supported by behavioural as well as electrophysiological evidence and has desirable consequences for both the generalisability and efficiency of reinforcement learning algorithms. However, it is unclear how the successor representation might be learnt in the brain. Error-driven temporal difference learning, commonly used to learn successor representations in artificial agents, is not known to be implemented in hippocampal networks. Instead, we demonstrate that spike-timing dependent plasticity (STDP), a form of Hebbian learning, acting on temporally compressed trajectories known as ‘theta sweeps’, is sufficient to rapidly learn a close approximation to the successor representation. The model is biologically plausible – it uses spiking neurons modulated by theta-band oscillations, diffuse and overlapping place cell-like state representations, and experimentally matched parameters. We show how this model maps onto known aspects of hippocampal circuitry and explains substantial variance in the temporal difference successor matrix, consequently giving rise to place cells that demonstrate experimentally observed successor representation-related phenomena including backwards expansion on a 1D track and elongation near walls in 2D. Finally, our model provides insight into the observed topographical ordering of place field sizes along the dorsal-ventral axis by showing this is necessary to prevent the detrimental mixing of larger place fields, which encode longer timescale successor representations, with more fine-grained predictions of spatial location.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

NeuronsHippocampusReinforcement, PsychologyBehavior TherapyAlgorithmsTheta RhythmModels, NeurologicalAction Potentials

Stichwörter der Autor:innen

STDPhippocampusneurosciencenonephase precessionplace cellssuccessor representationstheta

Autor:innen und Institutionen

  • Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, United Kingdom.
  • Research Department of Cell and Developmental Biology, University College London, London, United Kingdom.
  • DeepMind, London, United Kingdom.

ORCID-Profile: Tom M George, William de Cothi, Kimberly L Stachenfeld, Caswell Barry

Förderung

  • Wellcome Trust

Zitieren

APA

George, T. M., de Cothi, W., Stachenfeld, K. L., & Barry, C. (2023). Rapid learning of predictive maps with STDP and theta phase precession. eLife, 12. https://doi.org/10.7554/elife.80663

Vancouver

George TM, de Cothi W, Stachenfeld KL, Barry C. Rapid learning of predictive maps with STDP and theta phase precession. eLife. 2023;12. doi:10.7554/elife.80663

BibTeX
@article{George2023,
  author = {George, Tom M and de Cothi, William and Stachenfeld, Kimberly L and Barry, Caswell},
  title = {Rapid learning of predictive maps with STDP and theta phase precession},
  journal = {eLife},
  year = {2023},
  volume = {12},
  doi = {10.7554/elife.80663}
}
Kostenlos starten →