EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Hedging using reinforcement learning: Contextual k-armed bandit versus Q-learning

Loris Cannelli, Giuseppe Nuti, Marzio Sala, Oleg Szehr

The Journal of Finance and Data Science · 2023-11 · 9 · 100101

DOI: 10.1016/j.jfds.2023.100101 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of Finance and Data Science, 2023-11. Verfasst von Loris Cannelli und 3 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: UBS.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The construction of replication strategies for contingent claims in the presence of risk and market friction is a key problem of financial engineering. In real markets, continuous replication, such as in the model of Black, Scholes and Merton, is not only unrealistic but it is also undesirable due to high transaction costs. Over the last decades stochastic optimal-control methods have been developed to balance between effective replication and losses. More recently, with the rise of artificial intelligence, temporal-difference Reinforcement Learning, in particular variations of $Q$-learning in conjunction with Deep Neural Networks, have attracted significant interest. From a practical point of view, however, such methods are often relatively sample inefficient, hard to train and lack performance guarantees. This motivates the investigation of a stable benchmark algorithm for hedging. In this article, the hedging problem is viewed as an instance of a risk-averse contextual $k$-armed bandit problem, for which a large body of theoretical results and well-studied algorithms are available. We find that the $k$-armed bandit model naturally fits to the $P\&L$ formulation of hedging, providing for a more accurate and sample efficient approach than $Q$-learning and reducing to the Black-Scholes model in the absence of transaction costs and risks.

Förderung

  • UBS

Zitieren

APA

Cannelli, L., Nuti, G., Sala, M., & Szehr, O. (2023). Hedging using reinforcement learning: Contextual k-armed bandit versus Q-learning. The Journal of Finance and Data Science, 9, 100101. https://doi.org/10.1016/j.jfds.2023.100101

Vancouver

Cannelli L, Nuti G, Sala M, Szehr O. Hedging using reinforcement learning: Contextual k-armed bandit versus Q-learning. The Journal of Finance and Data Science. 2023;9:100101. doi:10.1016/j.jfds.2023.100101

BibTeX
@article{Cannelli2023,
  author = {Cannelli, Loris and Nuti, Giuseppe and Sala, Marzio and Szehr, Oleg},
  title = {Hedging using reinforcement learning: Contextual k-armed bandit versus Q-learning},
  journal = {The Journal of Finance and Data Science},
  year = {2023},
  volume = {9},
  pages = {100101},
  doi = {10.1016/j.jfds.2023.100101}
}
Kostenlos starten →