EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

OR for the classroom: the linear programming approach to approximate dynamic programming for Markov decision processes

Christiane Barz, Simon Laumer

Mathematical Methods of Operations Research · 14.05.2026

DOI: 10.1007/s00186-026-00929-3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematical Methods of Operations Research, online erschienen am 14.05.2026. Verfasst von Christiane Barz und 1 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

When the curse of dimensionality prevents an exact solution to a Markov decision process, approximate dynamic programming methods seek approximate solutions. This tutorial introduces the linear programming approach to approximate dynamic programming and three typical solution techniques, which are most suited for settings with a discrete and high-dimensional state space: constraint sampling, constraint generation, and compact reformulation. In our presentation, we assume that the target audience is familiar with the foundations of Markov decision processes, dynamic programming, and linear programming. Even though the ideas we present are generally applicable, we explain the core ideas only in the context of infinite-horizon problems with a discounted-reward criterion. A running example is used throughout to anchor the key ideas and make the methods more accessible.

Zitieren

APA

Barz, C., & Laumer, S. (2026). OR for the classroom: the linear programming approach to approximate dynamic programming for Markov decision processes. Mathematical Methods of Operations Research. https://doi.org/10.1007/s00186-026-00929-3

Vancouver

Barz C, Laumer S. OR for the classroom: the linear programming approach to approximate dynamic programming for Markov decision processes. Mathematical Methods of Operations Research. 2026. doi:10.1007/s00186-026-00929-3

BibTeX
@article{Barz2026,
  author = {Barz, Christiane and Laumer, Simon},
  title = {OR for the classroom: the linear programming approach to approximate dynamic programming for Markov decision processes},
  journal = {Mathematical Methods of Operations Research},
  year = {2026},
  doi = {10.1007/s00186-026-00929-3}
}
Kostenlos starten →