EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Adaptive Portfolio Optimization via PPO-HER

Jiahui Zhang, Jinyu Xie

Journal of Global Trends in Social Science · 2025

DOI: 10.70731/6xd2xq47 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Global Trends in Social Science, 2025. Verfasst von Jiahui Zhang und 1 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We propose PPO-HER, a novel reinforcement learning framework for adaptive portfolio optimization in non-stationary markets, which integrates Proximal Policy Optimization (PPO) with Hindsight Experience Replay (HER) to address sparse rewards and dynamic market conditions. The proposed method reformulates the portfolio optimization problem as a goal-conditioned Markov Decision Process, where the agent learns to reallocate assets by processing spatiotemporal market data through a Transformer-based actor network. The reward function combines logarithmic returns, risk penalties, and sparse bonuses, while HER relabels suboptimal trajectories to improve sample efficiency. Moreover, the architecture employs a TimeSformer for cross-asset attention and a GRU-based critic with spectral normalization to stabilize training. Experimental results demonstrate that PPO-HER outperforms conventional methods in terms of risk-adjusted returns, particularly during regime shifts detected by an auxiliary Changepoint-LSTM module. The framework is implemented using cuDNN-accelerated PyTorch, enabling efficient high-frequency trading with liquidity constraints. Our approach achieves state-of-the-art performance by explicitly modeling non-stationary dependencies and dynamically adjusting reward shaping based on realized volatility.

Zitieren

APA

Zhang, J., & Xie, J. (2025). Adaptive Portfolio Optimization via PPO-HER. Journal of Global Trends in Social Science. https://doi.org/10.70731/6xd2xq47

Vancouver

Zhang J, Xie J. Adaptive Portfolio Optimization via PPO-HER. Journal of Global Trends in Social Science. 2025. doi:10.70731/6xd2xq47

BibTeX
@article{Zhang2025,
  author = {Zhang, Jiahui and Xie, Jinyu},
  title = {Adaptive Portfolio Optimization via PPO-HER},
  journal = {Journal of Global Trends in Social Science},
  year = {2025},
  doi = {10.70731/6xd2xq47}
}
Kostenlos starten →