EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Mixtures of strategies underlie rodent behavior during reversal learning

Nhat Minh Le, Murat Yildirim iD, Yizhi Wang, Hiroki Sugihara, Mehrdad Jazayeri iD, Mriganka Sur iD

PLOS Computational Biology · 14.09.2023 · 19 (9) · e1011430

DOI: 10.1371/journal.pcbi.1011430 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 14.09.2023. Verfasst von Nhat Minh Le und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America. Hauptthemen laut MEDLINE: Reversal Learning, Algorithms. Die Arbeit wurde bisher 42-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIBIB NIH HHS, NIMH NIH HHS, NINDS NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In reversal learning tasks, the behavior of humans and animals is often assumed to be uniform within single experimental sessions to facilitate data analysis and model fitting. However, behavior of agents can display substantial variability in single experimental sessions, as they execute different blocks of trials with different transition dynamics. Here, we observed that in a deterministic reversal learning task, mice display noisy and sub-optimal choice transitions even at the expert stages of learning. We investigated two sources of the sub-optimality in the behavior. First, we found that mice exhibit a high lapse rate during task execution, as they reverted to unrewarded directions after choice transitions. Second, we unexpectedly found that a majority of mice did not execute a uniform strategy, but rather mixed between several behavioral modes with different transition dynamics. We quantified the use of such mixtures with a state-space model, block Hidden Markov Model (block HMM), to dissociate the mixtures of dynamic choice transitions in individual blocks of trials. Additionally, we found that blockHMM transition modes in rodent behavior can be accounted for by two different types of behavioral algorithms, model-free or inference-based learning, that might be used to solve the task. Combining these approaches, we found that mice used a mixture of both exploratory, model-free strategies and deterministic, inference-based behavior in the task, explaining their overall noisy choice sequences. Together, our combined computational approach highlights intrinsic sources of noise in rodent reversal learning behavior and provides a richer description of behavior than conventional techniques, while uncovering the hidden states that underlie the block-by-block transitions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Reversal LearningAlgorithmsHumansAnimalsMiceData Analysis

Autor:innen und Institutionen

  • Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
  • Picower Institute for Learning and Memory, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
  • Department of Neurosciences, Cleveland Clinic Lerner Research Institute, Cleveland, Ohio, United States of America.
  • McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.

ORCID-Profile: Murat Yildirim, Mehrdad Jazayeri, Mriganka Sur

Förderung

  • NIBIB NIH HHS
  • NIMH NIH HHS
  • NINDS NIH HHS
  • National Institutes of Health
  • National Institute of Health
  • Cleveland Clinic and IBM Discovery Accelerator Grant
  • Army Research Office
  • Massachusetts Institute of Technology

Zitieren

APA

Le, N. M., Yildirim, M., Wang, Y., Sugihara, H., Jazayeri, M., & Sur, M. (2023). Mixtures of strategies underlie rodent behavior during reversal learning. PLOS Computational Biology, 19(9), e1011430. https://doi.org/10.1371/journal.pcbi.1011430

Vancouver

Le NM, Yildirim M, Wang Y, Sugihara H, Jazayeri M, Sur M. Mixtures of strategies underlie rodent behavior during reversal learning. PLOS Computational Biology. 2023;19(9):e1011430. doi:10.1371/journal.pcbi.1011430

BibTeX
@article{Le2023,
  author = {Le, Nhat Minh and Yildirim, Murat and Wang, Yizhi and Sugihara, Hiroki and Jazayeri, Mehrdad and Sur, Mriganka},
  title = {Mixtures of strategies underlie rodent behavior during reversal learning},
  journal = {PLOS Computational Biology},
  year = {2023},
  volume = {19},
  number = {9},
  pages = {e1011430},
  doi = {10.1371/journal.pcbi.1011430}
}
Kostenlos starten →