EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling

Jamal Esmaily, Rani Moran, Yasser Roudi, Bahador Bahrami

Neural Computation · 27.07.2026 · 38 (8) · 1344-1375

DOI: 10.1162/neco.a.1543 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neural Computation, online erschienen am 27.07.2026. Verfasst von Jamal Esmaily und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of General Psychology and Education and Graduate School of Systemic Neurosciences, Ludwig Maximilians University Munich, 80539, Munich, Ge…. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Although evidence integration to the boundary model has successfully explained a wide range of behavioral and neural data in decision making under uncertainty, how animals learn and optimize the boundary remains unresolved. Here, we propose a model-free reinforcement learning algorithm for perceptual decisions under uncertainty that implements a sequential sampling process with an implicit decision boundary. Our model learns whether to commit to a decision given the available evidence or continue sampling information at a cost. We reproduced the canonical features of perceptual decision making such as dependence of accuracy and reaction time on evidence strength, modulation of speed-accuracy trade-off by payoff regime, and many others. By unifying learning and decision making within the same framework, this model can inspire a new look at the mechanisms of flexibility in context-dependent changes of behavior.

Autor:innen und Institutionen

  • Department of General Psychology and Education and Graduate School of Systemic Neurosciences, Ludwig Maximilians University Munich, 80539, Munich, Germany.
  • Perioperative, Acute, Critical Care and Emergency Medicine, Department of Medicine, University of Cambridge, Cambridge CB2 0QQ, UK jes248@cam.ac.uk.
  • Max Planck University College London, Centre for Computational Psychiatry and Ageing Research, and Wellcome Centre for Human Neuroimaging, University College London, Queen Square Institute of Neurology, E1 4NS London, U…
  • Wellcome Centre for Human Neuroimaging, University College London, Queen Square Institute of Neurology, London, UK.
  • School of Biological and Behavioural Sciences, Queen Mary University of London, E1 4NS London, UK r.moran@qmul.ac.uk.
  • Kavli Institute for Systems Neuroscience, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, 7491 Trondheim, Norway.

Zitieren

APA

Esmaily, J., Moran, R., Roudi, Y., & Bahrami, B. (2026). A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling. Neural Computation, 38(8), 1344-1375. https://doi.org/10.1162/neco.a.1543

Vancouver

Esmaily J, Moran R, Roudi Y, Bahrami B. A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling. Neural Computation. 2026;38(8):1344-1375. doi:10.1162/neco.a.1543

BibTeX
@article{Esmaily2026,
  author = {Esmaily, Jamal and Moran, Rani and Roudi, Yasser and Bahrami, Bahador},
  title = {A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling},
  journal = {Neural Computation},
  year = {2026},
  volume = {38},
  number = {8},
  pages = {1344--1375},
  doi = {10.1162/neco.a.1543}
}
Kostenlos starten →