EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States

Marcin Makowski iD, Edward W Piotrowski iD, Jan L Cieśliński iD

Entropy · 04.08.2026 · 28 (8) · 875

DOI: 10.3390/e28080875 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 04.08.2026. Verfasst von Marcin Makowski und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Physics, Department of Mathematical Methods in Physics, University of Białystok, ul. Ciołkowskiego 1L, 15-245 Białystok, Poland. Die Arbeit nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present an analogue of the classical Gittins index for a one-armed decision problem with a continuous spectrum of payoffs. The model assumes that the decision-maker observes independent realizations of a random variable and, at each step, decides whether to accept the current opportunity or continue observing. We show that the optimal strategy takes the form of a threshold rule, while the corresponding reservation index is determined by a one-dimensional fixed-point equation with a direct decision-theoretic interpretation. The model is illustrated with an example of bookmaker betting related to horse racing and the Kelly criterion. This perspective allows the proposed index to be viewed as a threshold of informational advantage. This, in turn, points to potential applications in optimal stopping problems and decision-making under uncertainty.

Schlagwörter

Stichwörter der Autor:innen

Gittins indexKelly criterionKullback–Leibler divergenceoptimal stoppingreinforcement learning

Autor:innen und Institutionen

  • Faculty of Physics, Department of Mathematical Methods in Physics, University of Białystok, ul. Ciołkowskiego 1L, 15-245 Białystok, Poland.
  • Independent Researcher, 15-667 Białystok, Poland.

ORCID-Profile: Marcin Makowski, Edward W Piotrowski, Jan L Cieśliński

Zitieren

APA

Makowski, M., Piotrowski, E. W., & Cieśliński, J. L. (2026). The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States. Entropy, 28(8), 875. https://doi.org/10.3390/e28080875

Vancouver

Makowski M, Piotrowski EW, Cieśliński JL. The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States. Entropy. 2026;28(8):875. doi:10.3390/e28080875

BibTeX
@article{Makowski2026,
  author = {Makowski, Marcin and Piotrowski, Edward W and Cieśliński, Jan L},
  title = {The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States},
  journal = {Entropy},
  year = {2026},
  volume = {28},
  number = {8},
  pages = {875},
  doi = {10.3390/e28080875}
}
Kostenlos starten →