The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States
Entropy · 04.08.2026 · 28 (8) · 875
DOI: 10.3390/e28080875 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 04.08.2026. Verfasst von Marcin Makowski und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Physics, Department of Mathematical Methods in Physics, University of Białystok, ul. Ciołkowskiego 1L, 15-245 Białystok, Poland. Die Arbeit nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
We present an analogue of the classical Gittins index for a one-armed decision problem with a continuous spectrum of payoffs. The model assumes that the decision-maker observes independent realizations of a random variable and, at each step, decides whether to accept the current opportunity or continue observing. We show that the optimal strategy takes the form of a threshold rule, while the corresponding reservation index is determined by a one-dimensional fixed-point equation with a direct decision-theoretic interpretation. The model is illustrated with an example of bookmaker betting related to horse racing and the Kelly criterion. This perspective allows the proposed index to be viewed as a threshold of informational advantage. This, in turn, points to potential applications in optimal stopping problems and decision-making under uncertainty.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Physics, Department of Mathematical Methods in Physics, University of Białystok, ul. Ciołkowskiego 1L, 15-245 Białystok, Poland.
- Independent Researcher, 15-667 Białystok, Poland.
ORCID-Profile: Marcin Makowski, Edward W Piotrowski, Jan L Cieśliński
Zitieren
APA
Makowski, M., Piotrowski, E. W., & Cieśliński, J. L. (2026). The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States. Entropy, 28(8), 875. https://doi.org/10.3390/e28080875
Vancouver
Makowski M, Piotrowski EW, Cieśliński JL. The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States. Entropy. 2026;28(8):875. doi:10.3390/e28080875
BibTeX
@article{Makowski2026,
author = {Makowski, Marcin and Piotrowski, Edward W and Cieśliński, Jan L},
title = {The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States},
journal = {Entropy},
year = {2026},
volume = {28},
number = {8},
pages = {875},
doi = {10.3390/e28080875}
}
EUVIMED