EUVIMEDEUVIMED entdecken
Crossref

Markov Decision Processes: On the Convergence of the Monte-Carlo First-Visit Algorithm

Sylvain Delattre, Nicolas Fournier

SIAM Journal on Control and Optimization · 30.06.2026 · 64 (3) · 1672-1697

DOI: 10.1137/25m1726200 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SIAM Journal on Control and Optimization, online erschienen am 03.06.2026. Verfasst von Sylvain Delattre und 1 weiteren Autor:innen. Die Arbeit nennt 14 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We consider the Monte-Carlo first-visit algorithm, of which the goal is to find the optimal control in a Markov decision process with finite state space and finite number of possible actions. We show its convergence when the discount factor is smaller than [Formula: see text].

Zitieren

APA

Delattre, S., & Fournier, N. (2026). Markov Decision Processes: On the Convergence of the Monte-Carlo First-Visit Algorithm. SIAM Journal on Control and Optimization, 64(3), 1672-1697. https://doi.org/10.1137/25m1726200

Vancouver

Delattre S, Fournier N. Markov Decision Processes: On the Convergence of the Monte-Carlo First-Visit Algorithm. SIAM Journal on Control and Optimization. 2026;64(3):1672-1697. doi:10.1137/25m1726200

BibTeX
@article{Delattre2026,
  author = {Delattre, Sylvain and Fournier, Nicolas},
  title = {Markov Decision Processes: On the Convergence of the Monte-Carlo First-Visit Algorithm},
  journal = {SIAM Journal on Control and Optimization},
  year = {2026},
  volume = {64},
  number = {3},
  pages = {1672--1697},
  doi = {10.1137/25m1726200}
}
Kostenlos starten →