EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Information uncertainty influences learning strategy from sequentially delayed rewards

Sean R Maulhardt iD, Alec Solway, Caroline J Charpentier

PLOS Computational Biology · 2026

DOI: 10.1371/journal.pcbi.1013879 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, 2026. Verfasst von Sean R Maulhardt und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Maryland College Park, College Park, Maryland, United States of America. Hauptthemen laut MEDLINE: Reward, Learning. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIMH NIH HHS, University of Maryland, National Institute of Mental Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

When receiving a reward after a sequence of multiple events, how do we determine which event caused the reward? This problem, known as temporal credit assignment, can be difficult for humans to solve given the temporal uncertainty in the environment. Research to date has attempted to isolate dimensions of delay and reward during decision-making, but algorithmic solutions to temporal learning problems and the effect of uncertainty on learning remain underexplored. To further our understanding, we adapted a reward learning task that creates a temporal credit assignment problem by combining sequentially delayed rewards, intervening events, and varying uncertainty via the amount of information presented during feedback. Using computational modeling, two learning strategies were developed: an eligibility trace, whereby previously selected actions are updated as a function of the temporal sequence, and a tabular update, whereby only systematically related past actions (rather than unrelated intervening events) are updated. We hypothesized that reduced information uncertainty would correlate with increased use of the tabular strategy, given the model’s capacity to incorporate additional feedback information. Both models effectively learned the task, and predicted choices made by participants (N = 142) as well as specific behavioral signatures of credit assignment. Consistent with our hypothesis, the tabular model outperformed the eligibility model under low information uncertainty, as evidenced by more accurate predictions of participants’ behavior and an increase in tabular weight. These findings provide new insights into the mechanisms implemented by humans to solve temporal credit assignment and adapt their strategy in varying environments.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RewardLearningHumansUncertaintyComputer SimulationDecision MakingComputational BiologyAlgorithms

Autor:innen und Institutionen

  • Department of Psychology, University of Maryland College Park, College Park, Maryland, United States of America.
  • Brain and Behavior Institute, University of Maryland College Park, College Park, Maryland, United States of America.

ORCID-Profile: Sean R Maulhardt

Förderung

  • NIMH NIH HHS
  • University of Maryland
  • National Institute of Mental Health

Zitieren

APA

Maulhardt, S. R., Solway, A., & Charpentier, C. J. (2026). Information uncertainty influences learning strategy from sequentially delayed rewards. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1013879

Vancouver

Maulhardt SR, Solway A, Charpentier CJ. Information uncertainty influences learning strategy from sequentially delayed rewards. PLOS Computational Biology. 2026. doi:10.1371/journal.pcbi.1013879

BibTeX
@article{Maulhardt2026,
  author = {Maulhardt, Sean R and Solway, Alec and Charpentier, Caroline J},
  title = {Information uncertainty influences learning strategy from sequentially delayed rewards},
  journal = {PLOS Computational Biology},
  year = {2026},
  doi = {10.1371/journal.pcbi.1013879}
}
Kostenlos starten →