Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour
European Journal of Neuroscience · 2024
DOI: 10.1111/ejn.16449 ↗Kurz gefasst
Fachartikel in der Zeitschrift European Journal of Neuroscience, 2024. Verfasst von François Cinotti und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institut des Systèmes Intelligents et de Robotique, Sorbonne Université, CNRS, Paris, France. Hauptthemen laut MEDLINE: Reinforcement, Psychology, Behavior, Animal. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agence Nationale de la Recherche, CRCNS 2015 Project, Agriculture, Food and Health research theme.
Abstract (Originalsprache)
In uncertain environments in which resources fluctuate continuously, animals must permanently decide whether to stabilise learning and exploit what they currently believe to be their best option, or instead explore potential alternatives and learn fast from new observations. While such a trade‐off has been extensively studied in pretrained animals facing non‐stationary decision‐making tasks, it is yet unknown how they progressively tune it while learning the task structure during pretraining. Here, we compared the ability of different computational models to account for long‐term changes in the behaviour of 24 rats while they learned to choose a rewarded lever in a three‐armed bandit task across 24 days of pretraining. We found that the day‐by‐day evolution of rat performance and win‐shift tendency revealed a progressive stabilisation of the way they regulated reinforcement learning parameters. We successfully captured these behavioural adaptations using a meta‐learning model in which either the learning rate or the inverse temperature was controlled by the average reward rate.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institut des Systèmes Intelligents et de Robotique, Sorbonne Université, CNRS, Paris, France.
- University of Reading, School of Psychology and Clinical Language Sciences, Whiteknights, Reading, UK.
- INCIA, CNRS UMR 5287, Université de Bordeaux, Bordeaux, France.
ORCID-Profile: François Cinotti, Etienne Coutureau, Mehdi Khamassi, Alain R Marchand, Benoît Girard
Förderung
- Agence Nationale de la Recherche
- CRCNS 2015 Project
- Agriculture, Food and Health research theme
Zitieren
APA
Cinotti, F., Coutureau, E., Khamassi, M., Marchand, A. R., & Girard, B. (2024). Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour. European Journal of Neuroscience. https://doi.org/10.1111/ejn.16449
Vancouver
Cinotti F, Coutureau E, Khamassi M, Marchand AR, Girard B. Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour. European Journal of Neuroscience. 2024. doi:10.1111/ejn.16449
BibTeX
@article{Cinotti2024,
author = {Cinotti, François and Coutureau, Etienne and Khamassi, Mehdi and Marchand, Alain R and Girard, Benoît},
title = {Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour},
journal = {European Journal of Neuroscience},
year = {2024},
doi = {10.1111/ejn.16449}
}
EUVIMED