EUVIMEDEUVIMED entdecken
Crossref

On Deep Reinforcement Learning for Dynamic Trading with PPO: Challenges and Future Directions

Alessio Brini, Petter N. Kolm

The Journal of Financial Data Science · 30.04.2026 · 8 (2) · 31-52

DOI: 10.3905/jfds.2026.001 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of Financial Data Science, online erschienen am 14.03.2026. Verfasst von Alessio Brini und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Model-free deep reinforcement learning (DRL) offers a flexible framework for sequential decision making in finance but faces unique challenges from the stochastic, nonstationary nature of financial markets. We examine the proximal policy optimization (PPO) algorithm for dynamic trading with time-varying alpha and price impact. Using a simulated environment with a closed-form optimal policy, we benchmark PPO’s efficiency and accuracy. We demonstrate how methods of bounding and rescaling its continuous action space significantly impact the training and performance of the DRL agent. We find that clipping the action space yields faster in-sample convergence, and rescaling actions to match the actual range of possible trades is essential for unbiased convergence to the optimal solution. In empirical tests on Dow Jones Industrial Average data with bootstrapped alphas, we show that PPO performance improves when signals are stronger and forecasts span multiple horizons. Our findings highlight the importance of domain-specific adaptations, particularly action space engineering and informative state design, when applying DRL to trading.

Zitieren

APA

Brini, A., & Kolm, P. N. (2026). On Deep Reinforcement Learning for Dynamic Trading with PPO: Challenges and Future Directions. The Journal of Financial Data Science, 8(2), 31-52. https://doi.org/10.3905/jfds.2026.001

Vancouver

Brini A, Kolm PN. On Deep Reinforcement Learning for Dynamic Trading with PPO: Challenges and Future Directions. The Journal of Financial Data Science. 2026;8(2):31-52. doi:10.3905/jfds.2026.001

BibTeX
@article{Brini2026,
  author = {Brini, Alessio and Kolm, Petter N.},
  title = {On Deep Reinforcement Learning for Dynamic Trading with PPO: Challenges and Future Directions},
  journal = {The Journal of Financial Data Science},
  year = {2026},
  volume = {8},
  number = {2},
  pages = {31--52},
  doi = {10.3905/jfds.2026.001}
}
Kostenlos starten →