EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing experimental design through Bayes factor design analysis: insights from multi-armed bandit tasks

Sarah Schreiber iD, Danielle Hewitt iD, Ben Seymour, Wako Yoshida iD

Wellcome Open Research · 07.05.2026 · 9 · 423

DOI: 10.12688/wellcomeopenres.22288.2 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Wellcome Open Research, online erschienen am 07.05.2026. Verfasst von Sarah Schreiber und 3 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Biomedical Engineering, University of Oxford, Oxford, England, OX37DQ, UK. Die Arbeit nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust, ARUK, EPSRC.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Bayesian statistics offers a flexible framework that supports iterative updating of hypotheses and the incorporation of prior information, amongst other advantages. Although well established for retrospective analysis, the application of Bayesian methods to prospective analysis is less well developed, especially when used in combination with computational model-based analysis of behavioural data in cognitive neuroscience. It is therefore important to establish effective methods for testing and optimising experimental designs for these purposes. One framework for a prospective approach is Bayes factor design analysis (BFDA), which can be used alongside latent variable modelling to evaluate and visualise the distribution of Bayes factors for a given experimental design. This paper provides a tutorial-style analysis combining BFDA with latent variable modelling to evaluate exploration-exploitation trade-offs in the binary multi-armed bandit task (MAB). This is a complex example of human decision-making with which to investigate the feasibility of differentiating latent variables between groups as a function of different design parameters. We examined how sample size, number of games per participant and effect size affect the strength of evidence supporting a difference in means between two groups. To further assess how these parameters affect experimental results, metrics of error were evaluated. Using simulations, we demonstrated how BFDA can be combined with latent variable modelling to evaluate and optimise parameter estimation of exploration in the MAB task, allowing inference of the mean degree of random exploration in a population, as well as between groups. However, BFDA indicated that, even with large samples and effect sizes, there may be some circumstances where there is a high likelihood of errors and a low probability of detecting evidence in favour of a difference when comparing random exploration between two groups performing the bandit task. In summary, we show how BFDA can prospectively inform design and power of human behavioural tasks.

Schlagwörter

Stichwörter der Autor:innen

Bayes factordecision-makingdesign analysisdesign calculationexplorationsample sizestatistical evidence

Autor:innen und Institutionen

  • Institute of Biomedical Engineering, University of Oxford, Oxford, England, OX37DQ, UK.
  • Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, England, OX39DU, UK.
  • Department of Neural Computation for Decision-making, Advanced Telecommunications Research Institute International, Kyoto, Japan.

ORCID-Profile: Sarah Schreiber, Danielle Hewitt, Wako Yoshida

Förderung

  • Wellcome Trust
  • ARUK
  • EPSRC
  • IITP
  • MRC 713
  • JSPS KAKENHI

Zitieren

APA

Schreiber, S., Hewitt, D., Seymour, B., & Yoshida, W. (2026). Enhancing experimental design through Bayes factor design analysis: insights from multi-armed bandit tasks. Wellcome Open Research, 9, 423. https://doi.org/10.12688/wellcomeopenres.22288.2

Vancouver

Schreiber S, Hewitt D, Seymour B, Yoshida W. Enhancing experimental design through Bayes factor design analysis: insights from multi-armed bandit tasks. Wellcome Open Research. 2026;9:423. doi:10.12688/wellcomeopenres.22288.2

BibTeX
@article{Schreiber2026,
  author = {Schreiber, Sarah and Hewitt, Danielle and Seymour, Ben and Yoshida, Wako},
  title = {Enhancing experimental design through Bayes factor design analysis: insights from multi-armed bandit tasks},
  journal = {Wellcome Open Research},
  year = {2026},
  volume = {9},
  pages = {423},
  doi = {10.12688/wellcomeopenres.22288.2}
}
Kostenlos starten →