Conditionally Elicitable Dynamic Risk Measures for Deep Reinforcement Learning
SIAM Journal on Financial Mathematics · 31.12.2023 · 14 (4) · 1249-1289
DOI: 10.1137/22m1527209 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Financial Mathematics, online erschienen am 14.11.2023. Verfasst von Anthony Coache und 2 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 68 Literaturangaben. Gefördert von: Natural Sciences and Engineering Research Council of Canada, Data Science Institute.
Abstract (Originalsprache)
We propose a novel framework to solve risk-sensitive reinforcement learning problems where the agent optimizes time-consistent dynamic spectral risk measures. Based on the notion of conditional elicitability, our methodology constructs (strictly consistent) scoring functions that are used as penalizers in the estimation procedure. Our contribution is threefold: we (i) devise an efficient approach to estimate a class of dynamic spectral risk measures with deep neural networks, (ii) prove that these dynamic spectral risk measures may be approximated to any arbitrary accuracy using deep neural networks, and (iii) develop a risk-sensitive actor-critic algorithm that uses full episodes and does not require any additional nested transitions. We compare our conceptually improved reinforcement learning algorithm with the nested simulation approach and illustrate its performance in two settings: statistical arbitrage and portfolio allocation on both simulated and real data.
Förderung
- Natural Sciences and Engineering Research Council of Canada
- Data Science Institute
Zitieren
APA
Coache, A., Jaimungal, S., & Cartea, Á. (2023). Conditionally Elicitable Dynamic Risk Measures for Deep Reinforcement Learning. SIAM Journal on Financial Mathematics, 14(4), 1249-1289. https://doi.org/10.1137/22m1527209
Vancouver
Coache A, Jaimungal S, Cartea Á. Conditionally Elicitable Dynamic Risk Measures for Deep Reinforcement Learning. SIAM Journal on Financial Mathematics. 2023;14(4):1249-1289. doi:10.1137/22m1527209
BibTeX
@article{Coache2023,
author = {Coache, Anthony and Jaimungal, Sebastian and Cartea, Álvaro},
title = {Conditionally Elicitable Dynamic Risk Measures for Deep Reinforcement Learning},
journal = {SIAM Journal on Financial Mathematics},
year = {2023},
volume = {14},
number = {4},
pages = {1249--1289},
doi = {10.1137/22m1527209}
}
EUVIMED