Extreme Occupation Measures in Markov Decision Processes with an Absorbing State
SIAM Journal on Control and Optimization · 29.02.2024 · 62 (1) · 65-90
DOI: 10.1137/23m1572398 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Control and Optimization, online erschienen am 12.01.2024. Verfasst von Alexey Piunovskiy und 1 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 42 Literaturangaben.
Abstract (Originalsprache)
In this paper, we consider a Markov decision process (MDP) with a Borel state space [Formula: see text], where [Formula: see text] is an absorbing state (cemetery), and a Borel action space [Formula: see text]. We consider the space of finite occupation measures restricted on [Formula: see text] and the extreme points in it. It is possible that some strategies have infinite occupation measures. Nevertheless, we prove that every finite extreme occupation measure is generated by a deterministic stationary strategy. Then, for this MDP, we consider a constrained problem with total undiscounted criteria and [Formula: see text] constraints, where the cost functions are nonnegative. By assumption, the strategies inducing infinite occupation measures are not optimal. Then our second main result is that, under mild conditions, the solution to this constrained MDP is given by a mixture of no more than [Formula: see text] occupation measures generated by deterministic stationary strategies.
Zitieren
APA
Piunovskiy, A., & Zhang, Y. (2024). Extreme Occupation Measures in Markov Decision Processes with an Absorbing State. SIAM Journal on Control and Optimization, 62(1), 65-90. https://doi.org/10.1137/23m1572398
Vancouver
Piunovskiy A, Zhang Y. Extreme Occupation Measures in Markov Decision Processes with an Absorbing State. SIAM Journal on Control and Optimization. 2024;62(1):65-90. doi:10.1137/23m1572398
BibTeX
@article{Piunovskiy2024,
author = {Piunovskiy, Alexey and Zhang, Yi},
title = {Extreme Occupation Measures in Markov Decision Processes with an Absorbing State},
journal = {SIAM Journal on Control and Optimization},
year = {2024},
volume = {62},
number = {1},
pages = {65--90},
doi = {10.1137/23m1572398}
}
EUVIMED