EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Human decision making balances reward maximization and policy compression

Lucy Lai iD, Samuel J Gershman

PLOS Computational Biology · 26.04.2024 · 20 (4) · e1012057

DOI: 10.1371/journal.pcbi.1012057 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 26.04.2024. Verfasst von Lucy Lai und 1 weiteren Autor:innen. Beteiligte Einrichtung: Program in Neuroscience, Harvard University, Cambridge, Massachusetts, United States of America. Hauptthemen laut MEDLINE: Reward, Decision Making. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation, Harvard Brain Science Initiative, National Science Foundation Graduate Research Fellowship Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Policy compression is a computational framework that describes how capacity-limited agents trade reward for simpler action policies to reduce cognitive cost. In this study, we present behavioral evidence that humans prefer simpler policies, as predicted by a capacity-limited reinforcement learning model. Across a set of tasks, we find that people exploit structure in the relationships between states, actions, and rewards to “compress” their policies. In particular, compressed policies are systematically biased towards actions with high marginal probability, thereby discarding some state information. This bias is greater when there is redundancy in the reward-maximizing action policy across states, and increases with memory load. These results could not be explained qualitatively or quantitatively by models that did not make use of policy compression under a capacity limit. We also confirmed the prediction that time pressure should further reduce policy complexity and increase action bias, based on the hypothesis that actions are selected via time-dependent decoding of a compressed code. These findings contribute to a deeper understanding of how humans adapt their decision-making strategies under cognitive resource constraints.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RewardDecision MakingHumansComputational BiologyMaleAdultFemaleReinforcement, PsychologyModels, PsychologicalYoung AdultCognition

Autor:innen und Institutionen

  • Program in Neuroscience, Harvard University, Cambridge, Massachusetts, United States of America.
  • Theoretical Sciences Visiting Program, Okinawa Institute of Science and Technology Graduate University, Onna, Okinawa, Japan.
  • Department of Psychology and Center for Brain Science, Harvard University, Cambridge, Massachusetts, United States of America.

ORCID-Profile: Lucy Lai

Förderung

  • National Science Foundation
  • Harvard Brain Science Initiative
  • National Science Foundation Graduate Research Fellowship Program
  • 28Twelve Foundation Harvey Fellowship

Zitieren

APA

Lai, L., & Gershman, S. J. (2024). Human decision making balances reward maximization and policy compression. PLOS Computational Biology, 20(4), e1012057. https://doi.org/10.1371/journal.pcbi.1012057

Vancouver

Lai L, Gershman SJ. Human decision making balances reward maximization and policy compression. PLOS Computational Biology. 2024;20(4):e1012057. doi:10.1371/journal.pcbi.1012057

BibTeX
@article{Lai2024,
  author = {Lai, Lucy and Gershman, Samuel J},
  title = {Human decision making balances reward maximization and policy compression},
  journal = {PLOS Computational Biology},
  year = {2024},
  volume = {20},
  number = {4},
  pages = {e1012057},
  doi = {10.1371/journal.pcbi.1012057}
}
Kostenlos starten →