EUVIMEDEUVIMED entdecken
Crossref

Fast and robust Bayesian inference for modular combinations of dynamic learning and decision models

Cognitive Science Society 2025, Krishn Bera, Alexander Fengler, Michael J. Frank

eScholarship (California Digital Library) · 18.06.2025

DOI: 10.48448/gy5e-1a52 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eScholarship (California Digital Library), erschienen am 18.06.2025. Verfasst von Cognitive Science Society 2025 und 3 weiteren Autor:innen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In cognitive neuroscience, there has been growing interest in adopting sequential sampling models (SSM) as the generative choice function for reinforcement learning (RLSSM) to jointly account for decision dynamics within and across trials. However, such approaches have been limited by computational tractability due to lack of closed-form likelihoods for the decision process or expensive trial-by-trial evaluation of complex reinforcement learning (RL) processes. We enable hierarchical Bayesian estimation for a broad class of RLSSM models, using Likelihood Approximation Networks (LANs) in conjunction with differentiable RL likelihoods to leverage fast gradient-based inference methods including Hamiltonian Monte Carlo or Variational Inference (VI). To showcase the scalability and faster convergence with our approach, we consider the Reinforcement Learning - Working Memory (RLWM) task and model with multiple interacting generative learning processes. We show that our method enables accurate recovery of the posterior parameter distributions in arbitrarily complex RLSSM paradigms, and moreover, that in comparison, fitting data with the equivalent choice-only model yields a biased estimator of the true generative process. Moreover, leveraging the SSM with efficient inference allows us to uncover a heretofore undescribed cognitive process within the RLWM task, whereby participants proactively adjust the decision threshold as a function of WM load.

Schlagwörter

sequential sampling modelsreinforcement learninghierarchical Bayesian inferencedecision thresholdworking memorycomputational cognitive modelingvariational inferenceHamiltonian Monte Carlodecision dynamics

Zitieren

APA

2025, C. S. S., Bera, K., Fengler, A., & Frank, M. J. (2025). Fast and robust Bayesian inference for modular combinations of dynamic learning and decision models. eScholarship (California Digital Library). https://doi.org/10.48448/gy5e-1a52

Vancouver

2025 CSS, Bera K, Fengler A, Frank MJ. Fast and robust Bayesian inference for modular combinations of dynamic learning and decision models. eScholarship (California Digital Library). 2025. doi:10.48448/gy5e-1a52

BibTeX
@article{2025,
  author = {2025, Cognitive Science Society and Bera, Krishn and Fengler, Alexander and Frank, Michael J.},
  title = {Fast and robust Bayesian inference for modular combinations of dynamic learning and decision models},
  journal = {eScholarship (California Digital Library)},
  year = {2025},
  doi = {10.48448/gy5e-1a52}
}
Kostenlos starten →