A Reinforcement Learning Framework for Execution Strategy with Slippage and Impact Constraints
International Journal of Computational and Biological Sciences · 31.12.2025 · 2 (02) · 261-268
DOI: 10.66238/ijcbs31 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computational and Biological Sciences, online erschienen am 31.12.2025. Verfasst von Jie Ma. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
The optimal execution of large financial orders is a fundamental problem in modern algorithmic trading, necessitating a delicate balance between market impact costs and market volatility risk. Traditional approaches, such as the Almgren-Chriss model, rely on closed-form solutions derived from rigid assumptions regarding market dynamics, which often fail to capture the stochastic and non-linear nature of liquidity in high-frequency environments. This paper presents a novel Reinforcement Learning (RL) framework designed to derive optimal execution strategies under strict slippage and impact constraints. We formulate the execution problem as a Markov Decision Process (MDP) where the agent learns to schedule trade volumes dynamically in response to real-time Limit Order Book (LOB) imbalances and price volatility. Unlike standard approaches that treat market impact as a deterministic penalty, our framework incorporates a stochastic impact model that accounts for transient liquidity resilience. We employ a Proximal Policy Optimization (PPO) algorithm, augmented with a Lagrangian relaxation technique to strictly enforce execution constraints. Our extensive simulation results using historical tick data demonstrate that the proposed RL agent significantly outperforms classic benchmarks such as Time-Weighted Average Price (TWAP) and Volume-Weighted Average Price (VWAP) in reducing Implementation Shortfall (IS), particularly in regimes of high volatility and low liquidity.
Zitieren
APA
Ma, J. (2025). A Reinforcement Learning Framework for Execution Strategy with Slippage and Impact Constraints. International Journal of Computational and Biological Sciences, 2(02), 261-268. https://doi.org/10.66238/ijcbs31
Vancouver
Ma J. A Reinforcement Learning Framework for Execution Strategy with Slippage and Impact Constraints. International Journal of Computational and Biological Sciences. 2025;2(02):261-268. doi:10.66238/ijcbs31
BibTeX
@article{Ma2025,
author = {Ma, Jie},
title = {A Reinforcement Learning Framework for Execution Strategy with Slippage and Impact Constraints},
journal = {International Journal of Computational and Biological Sciences},
year = {2025},
volume = {2},
number = {02},
pages = {261--268},
doi = {10.66238/ijcbs31}
}
EUVIMED