Towards multi‐agent reinforcement learning‐driven over‐the‐counter market simulations
Mathematical Finance · 2024-04 · 34 (2) · 262-347
DOI: 10.1111/mafi.12416 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematical Finance, online erschienen am 20.09.2023. Verfasst von Nelson Vadori und 9 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 86 Literaturangaben.
Abstract (Originalsprache)
We study a game between liquidity provider (LP) and liquidity taker agents interacting in an over‐the‐counter market, for which the typical example is foreign exchange. We show how a suitable design of parameterized families of reward functions coupled with shared policy learning constitutes an efficient solution to this problem. By playing against each other, our deep‐reinforcement‐learning‐driven agents learn emergent behaviors relative to a wide spectrum of objectives encompassing profit‐and‐loss, optimal execution, and market share. In particular, we find that LPs naturally learn to balance hedging and skewing, where skewing refers to setting their buy and sell prices asymmetrically as a function of their inventory. We further introduce a novel RL‐based calibration algorithm, which we found performed well at imposing constraints on the game equilibrium. On the theoretical side, we are able to show convergence rates for our multi‐agent policy gradient algorithm under a transitivity assumption, closely related to generalized ordinal potential games.
Zitieren
APA
Vadori, N., Ardon, L., Ganesh, S., Spooner, T., Amrouni, S., Vann, J., Xu, M., Zheng, Z., Balch, T., & Veloso, M. (2024). Towards multi‐agent reinforcement learning‐driven over‐the‐counter market simulations. Mathematical Finance, 34(2), 262-347. https://doi.org/10.1111/mafi.12416
Vancouver
Vadori N, Ardon L, Ganesh S, Spooner T, Amrouni S, Vann J, et al. Towards multi‐agent reinforcement learning‐driven over‐the‐counter market simulations. Mathematical Finance. 2024;34(2):262-347. doi:10.1111/mafi.12416
BibTeX
@article{Vadori2024,
author = {Vadori, Nelson and Ardon, Leo and Ganesh, Sumitra and Spooner, Thomas and Amrouni, Selim and Vann, Jared and Xu, Mengda and Zheng, Zeyu and Balch, Tucker and Veloso, Manuela},
title = {Towards multi‐agent reinforcement learning‐driven over‐the‐counter market simulations},
journal = {Mathematical Finance},
year = {2024},
volume = {34},
number = {2},
pages = {262--347},
doi = {10.1111/mafi.12416}
}
EUVIMED