EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour

François Cinotti iD, Etienne Coutureau iD, Mehdi Khamassi iD, Alain R Marchand iD, Benoît Girard iD

European Journal of Neuroscience · 2024

DOI: 10.1111/ejn.16449 ↗

Kurz gefasst

Fachartikel in der Zeitschrift European Journal of Neuroscience, 2024. Verfasst von François Cinotti und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institut des Systèmes Intelligents et de Robotique, Sorbonne Université, CNRS, Paris, France. Hauptthemen laut MEDLINE: Reinforcement, Psychology, Behavior, Animal. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agence Nationale de la Recherche, CRCNS 2015 Project, Agriculture, Food and Health research theme.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In uncertain environments in which resources fluctuate continuously, animals must permanently decide whether to stabilise learning and exploit what they currently believe to be their best option, or instead explore potential alternatives and learn fast from new observations. While such a trade‐off has been extensively studied in pretrained animals facing non‐stationary decision‐making tasks, it is yet unknown how they progressively tune it while learning the task structure during pretraining. Here, we compared the ability of different computational models to account for long‐term changes in the behaviour of 24 rats while they learned to choose a rewarded lever in a three‐armed bandit task across 24 days of pretraining. We found that the day‐by‐day evolution of rat performance and win‐shift tendency revealed a progressive stabilisation of the way they regulated reinforcement learning parameters. We successfully captured these behavioural adaptations using a meta‐learning model in which either the learning rate or the inverse temperature was controlled by the average reward rate.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Reinforcement, PsychologyBehavior, AnimalAnimalsMaleRatsRewardLearningRats, Long-Evans

Stichwörter der Autor:innen

decision‐makingdopamineexploration‐exploitation trade‐offmeta‐learning

Autor:innen und Institutionen

  • Institut des Systèmes Intelligents et de Robotique, Sorbonne Université, CNRS, Paris, France.
  • University of Reading, School of Psychology and Clinical Language Sciences, Whiteknights, Reading, UK.
  • INCIA, CNRS UMR 5287, Université de Bordeaux, Bordeaux, France.

ORCID-Profile: François Cinotti, Etienne Coutureau, Mehdi Khamassi, Alain R Marchand, Benoît Girard

Förderung

  • Agence Nationale de la Recherche
  • CRCNS 2015 Project
  • Agriculture, Food and Health research theme

Zitieren

APA

Cinotti, F., Coutureau, E., Khamassi, M., Marchand, A. R., & Girard, B. (2024). Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour. European Journal of Neuroscience. https://doi.org/10.1111/ejn.16449

Vancouver

Cinotti F, Coutureau E, Khamassi M, Marchand AR, Girard B. Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour. European Journal of Neuroscience. 2024. doi:10.1111/ejn.16449

BibTeX
@article{Cinotti2024,
  author = {Cinotti, François and Coutureau, Etienne and Khamassi, Mehdi and Marchand, Alain R and Girard, Benoît},
  title = {Regulation of reinforcement learning parameters captures long‐term changes in rat behaviour},
  journal = {European Journal of Neuroscience},
  year = {2024},
  doi = {10.1111/ejn.16449}
}
Kostenlos starten →