EUVIMEDEUVIMED entdecken
Crossref

Extreme Occupation Measures in Markov Decision Processes with an Absorbing State

Alexey Piunovskiy, Yi Zhang

SIAM Journal on Control and Optimization · 29.02.2024 · 62 (1) · 65-90

DOI: 10.1137/23m1572398 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SIAM Journal on Control and Optimization, online erschienen am 12.01.2024. Verfasst von Alexey Piunovskiy und 1 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 42 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we consider a Markov decision process (MDP) with a Borel state space [Formula: see text], where [Formula: see text] is an absorbing state (cemetery), and a Borel action space [Formula: see text]. We consider the space of finite occupation measures restricted on [Formula: see text] and the extreme points in it. It is possible that some strategies have infinite occupation measures. Nevertheless, we prove that every finite extreme occupation measure is generated by a deterministic stationary strategy. Then, for this MDP, we consider a constrained problem with total undiscounted criteria and [Formula: see text] constraints, where the cost functions are nonnegative. By assumption, the strategies inducing infinite occupation measures are not optimal. Then our second main result is that, under mild conditions, the solution to this constrained MDP is given by a mixture of no more than [Formula: see text] occupation measures generated by deterministic stationary strategies.

Zitieren

APA

Piunovskiy, A., & Zhang, Y. (2024). Extreme Occupation Measures in Markov Decision Processes with an Absorbing State. SIAM Journal on Control and Optimization, 62(1), 65-90. https://doi.org/10.1137/23m1572398

Vancouver

Piunovskiy A, Zhang Y. Extreme Occupation Measures in Markov Decision Processes with an Absorbing State. SIAM Journal on Control and Optimization. 2024;62(1):65-90. doi:10.1137/23m1572398

BibTeX
@article{Piunovskiy2024,
  author = {Piunovskiy, Alexey and Zhang, Yi},
  title = {Extreme Occupation Measures in Markov Decision Processes with an Absorbing State},
  journal = {SIAM Journal on Control and Optimization},
  year = {2024},
  volume = {62},
  number = {1},
  pages = {65--90},
  doi = {10.1137/23m1572398}
}
Kostenlos starten →