Human decision making balances reward maximization and policy compression
PLOS Computational Biology · 26.04.2024 · 20 (4) · e1012057
DOI: 10.1371/journal.pcbi.1012057 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 26.04.2024. Verfasst von Lucy Lai und 1 weiteren Autor:innen. Beteiligte Einrichtung: Program in Neuroscience, Harvard University, Cambridge, Massachusetts, United States of America. Hauptthemen laut MEDLINE: Reward, Decision Making. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation, Harvard Brain Science Initiative, National Science Foundation Graduate Research Fellowship Program.
Abstract (Originalsprache)
Policy compression is a computational framework that describes how capacity-limited agents trade reward for simpler action policies to reduce cognitive cost. In this study, we present behavioral evidence that humans prefer simpler policies, as predicted by a capacity-limited reinforcement learning model. Across a set of tasks, we find that people exploit structure in the relationships between states, actions, and rewards to “compress” their policies. In particular, compressed policies are systematically biased towards actions with high marginal probability, thereby discarding some state information. This bias is greater when there is redundancy in the reward-maximizing action policy across states, and increases with memory load. These results could not be explained qualitatively or quantitatively by models that did not make use of policy compression under a capacity limit. We also confirmed the prediction that time pressure should further reduce policy complexity and increase action bias, based on the hypothesis that actions are selected via time-dependent decoding of a compressed code. These findings contribute to a deeper understanding of how humans adapt their decision-making strategies under cognitive resource constraints.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Program in Neuroscience, Harvard University, Cambridge, Massachusetts, United States of America.
- Theoretical Sciences Visiting Program, Okinawa Institute of Science and Technology Graduate University, Onna, Okinawa, Japan.
- Department of Psychology and Center for Brain Science, Harvard University, Cambridge, Massachusetts, United States of America.
ORCID-Profile: Lucy Lai
Förderung
- National Science Foundation
- Harvard Brain Science Initiative
- National Science Foundation Graduate Research Fellowship Program
- 28Twelve Foundation Harvey Fellowship
Zitieren
APA
Lai, L., & Gershman, S. J. (2024). Human decision making balances reward maximization and policy compression. PLOS Computational Biology, 20(4), e1012057. https://doi.org/10.1371/journal.pcbi.1012057
Vancouver
Lai L, Gershman SJ. Human decision making balances reward maximization and policy compression. PLOS Computational Biology. 2024;20(4):e1012057. doi:10.1371/journal.pcbi.1012057
BibTeX
@article{Lai2024,
author = {Lai, Lucy and Gershman, Samuel J},
title = {Human decision making balances reward maximization and policy compression},
journal = {PLOS Computational Biology},
year = {2024},
volume = {20},
number = {4},
pages = {e1012057},
doi = {10.1371/journal.pcbi.1012057}
}
EUVIMED