EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Neural learning rules for generating flexible predictions and computing the successor representation

Ching Fang iD, Dmitriy Aronov iD, L F Abbott, Emily L Mackevicius iD

eLife · 16.03.2023 · 12

DOI: 10.7554/elife.80680 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eLife, online erschienen am 16.03.2023. Verfasst von Ching Fang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Zuckerman Institute, Department of Neuroscience, Columbia University, New York, United States. Hauptthemen laut MEDLINE: Learning, Neural Networks, Computer. Die Arbeit wurde bisher 63-mal zitiert (Crossref) und nennt 127 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIA NIH HHS, NIH HHS, National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The predictive nature of the hippocampus is thought to be useful for memory-guided cognitive behaviors. Inspired by the reinforcement learning literature, this notion has been formalized as a predictive map called the successor representation (SR). The SR captures a number of observations about hippocampal activity. However, the algorithm does not provide a neural mechanism for how such representations arise. Here, we show the dynamics of a recurrent neural network naturally calculate the SR when the synaptic weights match the transition probability matrix. Interestingly, the predictive horizon can be flexibly modulated simply by changing the network gain. We derive simple, biologically plausible learning rules to learn the SR in a recurrent network. We test our model with realistic inputs and match hippocampal data recorded during random foraging. Taken together, our results suggest that the SR is more accessible in neural circuits than previously thought and can support a broad range of cognitive functions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LearningNeural Networks, ComputerHippocampusReinforcement, PsychologyAlgorithms

Stichwörter der Autor:innen

hippocampusneuroscienceplasticitypredictive codingrecurrent neural networkstate-space modeltufted titmouse

Autor:innen und Institutionen

  • Zuckerman Institute, Department of Neuroscience, Columbia University, New York, United States.
  • Basis Research Institute, New York, United States.

ORCID-Profile: Ching Fang, Dmitriy Aronov, Emily L Mackevicius

Förderung

  • NIA NIH HHS
  • NIH HHS
  • National Science Foundation
  • Gatsby Charitable Foundation
  • New York Stem Cell Foundation
  • National Institutes of Health
  • Arnold and Mabel Beckman Foundation
  • Simons Foundation

Zitieren

APA

Fang, C., Aronov, D., Abbott, L. F., & Mackevicius, E. L. (2023). Neural learning rules for generating flexible predictions and computing the successor representation. eLife, 12. https://doi.org/10.7554/elife.80680

Vancouver

Fang C, Aronov D, Abbott LF, Mackevicius EL. Neural learning rules for generating flexible predictions and computing the successor representation. eLife. 2023;12. doi:10.7554/elife.80680

BibTeX
@article{Fang2023,
  author = {Fang, Ching and Aronov, Dmitriy and Abbott, L F and Mackevicius, Emily L},
  title = {Neural learning rules for generating flexible predictions and computing the successor representation},
  journal = {eLife},
  year = {2023},
  volume = {12},
  doi = {10.7554/elife.80680}
}
Kostenlos starten →