Reinforcement learning when your life depends on it: A neuro-economic theory of learning
PLOS Computational Biology · 2024
DOI: 10.1371/journal.pcbi.1012554 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, 2024. Verfasst von Jiamu Jiang und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Mathematical Sciences, University of Nottingham, Nottingham, United Kingdom. Hauptthemen laut MEDLINE: Reinforcement, Psychology. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nottingham Vice Chancellor’s International Scholarship, and Turing Enrichment Scheme, Nottingham Vice Chancellor’s International Scholarship.
Abstract (Originalsprache)
Synaptic plasticity enables animals to adapt to their environment, but memory formation can require a substantial amount of metabolic energy, potentially impairing survival. Hence, a neuro-economic dilemma arises whether learning is a profitable investment or not, and the brain must therefore judiciously regulate learning. Indeed, in experiments it was observed that during starvation, Drosophila suppress formation of energy-intensive aversive memories. Here we include energy considerations in a reinforcement learning framework. Simulated flies learned to avoid noxious stimuli through synaptic plasticity in either the energy expensive long-term memory (LTM) pathway, or the decaying anesthesia-resistant memory (ARM) pathway. The objective of the flies is to maximize their lifespan, which is calculated with a hazard function. We find that strategies that switch between the LTM and ARM pathways, based on energy reserve and reward prediction error, prolong lifespan. Our study highlights the significance of energy-regulation of memory pathways and dopaminergic control for adaptive learning and survival. It might also benefit engineering applications of reinforcement learning under resources constraints.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Mathematical Sciences, University of Nottingham, Nottingham, United Kingdom.
- School of Psychology, University of Nottingham, Nottingham, United Kingdom.
ORCID-Profile: Jiamu Jiang, Emilie Foyard, Mark C W van Rossum
Förderung
- Nottingham Vice Chancellor’s International Scholarship, and Turing Enrichment Scheme
- Nottingham Vice Chancellor’s International Scholarship
Zitieren
APA
Jiang, J., Foyard, E., & van Rossum, M. C. W. (2024). Reinforcement learning when your life depends on it: A neuro-economic theory of learning. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1012554
Vancouver
Jiang J, Foyard E, van Rossum MCW. Reinforcement learning when your life depends on it: A neuro-economic theory of learning. PLOS Computational Biology. 2024. doi:10.1371/journal.pcbi.1012554
BibTeX
@article{Jiang2024,
author = {Jiang, Jiamu and Foyard, Emilie and van Rossum, Mark C W},
title = {Reinforcement learning when your life depends on it: A neuro-economic theory of learning},
journal = {PLOS Computational Biology},
year = {2024},
doi = {10.1371/journal.pcbi.1012554}
}
EUVIMED