Markov Decision Processes: On the Convergence of the Monte-Carlo First-Visit Algorithm
SIAM Journal on Control and Optimization · 30.06.2026 · 64 (3) · 1672-1697
DOI: 10.1137/25m1726200 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Control and Optimization, online erschienen am 03.06.2026. Verfasst von Sylvain Delattre und 1 weiteren Autor:innen. Die Arbeit nennt 14 Literaturangaben.
Abstract (Originalsprache)
We consider the Monte-Carlo first-visit algorithm, of which the goal is to find the optimal control in a Markov decision process with finite state space and finite number of possible actions. We show its convergence when the discount factor is smaller than [Formula: see text].
Zitieren
APA
Delattre, S., & Fournier, N. (2026). Markov Decision Processes: On the Convergence of the Monte-Carlo First-Visit Algorithm. SIAM Journal on Control and Optimization, 64(3), 1672-1697. https://doi.org/10.1137/25m1726200
Vancouver
Delattre S, Fournier N. Markov Decision Processes: On the Convergence of the Monte-Carlo First-Visit Algorithm. SIAM Journal on Control and Optimization. 2026;64(3):1672-1697. doi:10.1137/25m1726200
BibTeX
@article{Delattre2026,
author = {Delattre, Sylvain and Fournier, Nicolas},
title = {Markov Decision Processes: On the Convergence of the Monte-Carlo First-Visit Algorithm},
journal = {SIAM Journal on Control and Optimization},
year = {2026},
volume = {64},
number = {3},
pages = {1672--1697},
doi = {10.1137/25m1726200}
}
EUVIMED