EUVIMEDEUVIMED entdecken
Crossref

A Sampling-Based Gittins Index Approximation

Stef Baas, Richard J. Boucherie, Aleida Braaksma

Mathematics of Operations Research · 19.03.2026

DOI: 10.1287/moor.2023.0225 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics of Operations Research, online erschienen am 19.03.2026. Verfasst von Stef Baas und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 57 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A sampling-based method is introduced to approximate the Gittins index for a general family of alternative bandit processes. The approximation consists of a truncation of the optimization horizon and support for the immediate rewards, an optimal stopping value approximation, and a stochastic approximation procedure. Finite-time error bounds are given for the three approximations, leading to a procedure to construct a confidence interval for the Gittins index using a finite number of Monte Carlo samples as well as an epsilon-optimal policy for the family of alternative bandit processes. Proofs are given for almost sure convergence and a central limit theorem for the sampling-based Gittins index approximation. In a numerical study, the quality of the approximation is verified for the Bernoulli bandit and the Gaussian bandit with known variance, and the method is shown to significantly outperform Thompson sampling and the Bayesian upper-confidence-bound algorithms for a novel random effects multi-armed bandit.

Zitieren

APA

Baas, S., Boucherie, R. J., & Braaksma, A. (2026). A Sampling-Based Gittins Index Approximation. Mathematics of Operations Research. https://doi.org/10.1287/moor.2023.0225

Vancouver

Baas S, Boucherie RJ, Braaksma A. A Sampling-Based Gittins Index Approximation. Mathematics of Operations Research. 2026. doi:10.1287/moor.2023.0225

BibTeX
@article{Baas2026,
  author = {Baas, Stef and Boucherie, Richard J. and Braaksma, Aleida},
  title = {A Sampling-Based Gittins Index Approximation},
  journal = {Mathematics of Operations Research},
  year = {2026},
  doi = {10.1287/moor.2023.0225}
}
Kostenlos starten →