EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reinforcement learning when your life depends on it: A neuro-economic theory of learning

Jiamu Jiang iD, Emilie Foyard iD, Mark C W van Rossum iD

PLOS Computational Biology · 2024

DOI: 10.1371/journal.pcbi.1012554 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, 2024. Verfasst von Jiamu Jiang und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Mathematical Sciences, University of Nottingham, Nottingham, United Kingdom. Hauptthemen laut MEDLINE: Reinforcement, Psychology. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nottingham Vice Chancellor’s International Scholarship, and Turing Enrichment Scheme, Nottingham Vice Chancellor’s International Scholarship.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Synaptic plasticity enables animals to adapt to their environment, but memory formation can require a substantial amount of metabolic energy, potentially impairing survival. Hence, a neuro-economic dilemma arises whether learning is a profitable investment or not, and the brain must therefore judiciously regulate learning. Indeed, in experiments it was observed that during starvation, Drosophila suppress formation of energy-intensive aversive memories. Here we include energy considerations in a reinforcement learning framework. Simulated flies learned to avoid noxious stimuli through synaptic plasticity in either the energy expensive long-term memory (LTM) pathway, or the decaying anesthesia-resistant memory (ARM) pathway. The objective of the flies is to maximize their lifespan, which is calculated with a hazard function. We find that strategies that switch between the LTM and ARM pathways, based on energy reserve and reward prediction error, prolong lifespan. Our study highlights the significance of energy-regulation of memory pathways and dopaminergic control for adaptive learning and survival. It might also benefit engineering applications of reinforcement learning under resources constraints.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Reinforcement, PsychologyAnimalsNeuronal PlasticityComputational BiologyMemory, Long-TermLongevityModels, NeurologicalLearningDrosophilaDrosophila melanogasterComputer SimulationMemoryEnergy MetabolismBrain

Autor:innen und Institutionen

  • School of Mathematical Sciences, University of Nottingham, Nottingham, United Kingdom.
  • School of Psychology, University of Nottingham, Nottingham, United Kingdom.

ORCID-Profile: Jiamu Jiang, Emilie Foyard, Mark C W van Rossum

Förderung

  • Nottingham Vice Chancellor’s International Scholarship, and Turing Enrichment Scheme
  • Nottingham Vice Chancellor’s International Scholarship

Zitieren

APA

Jiang, J., Foyard, E., & van Rossum, M. C. W. (2024). Reinforcement learning when your life depends on it: A neuro-economic theory of learning. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1012554

Vancouver

Jiang J, Foyard E, van Rossum MCW. Reinforcement learning when your life depends on it: A neuro-economic theory of learning. PLOS Computational Biology. 2024. doi:10.1371/journal.pcbi.1012554

BibTeX
@article{Jiang2024,
  author = {Jiang, Jiamu and Foyard, Emilie and van Rossum, Mark C W},
  title = {Reinforcement learning when your life depends on it: A neuro-economic theory of learning},
  journal = {PLOS Computational Biology},
  year = {2024},
  doi = {10.1371/journal.pcbi.1012554}
}
Kostenlos starten →