EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

E-Commerce Dynamic Pricing Optimization Using Double Deep Q-Network and Reward Shaping

NAZAL Mahendra, Majid Rahardi

Journal of Information System Exploration and Research · 08.10.2026 · 4 (4) · 451-462

DOI: 10.52465/joiser.v4i4.90 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Information System Exploration and Research, online erschienen am 08.10.2026. Verfasst von NAZAL Mahendra und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Dynamic pricing is crucial for e-commerce platforms to adapt to rapidly fluctuating market demands. However, conventional reinforcement learning methods, such as Tabular Q-Learning, suffer from the curse of dimensionality and discretization errors. Furthermore, the Deep Q-Networks (DQN) standard often encounters overestimation bias, leading to aggressive price drops and severe financial losses known as the Death Spiral. This study aims to address these issues by proposing a continuous Markov Decision Process (MDP) environment using a Double Deep Q-Network (DDQN) architecture. The model is trained using historical time-series data from the Brazilian E-Commerce Public Dataset by Olist. The proposed innovations include internal State Normalization to eliminate Gradient Domination, and adaptive Reward Shaping paired with absolute economic Guardrails to strictly prevent the AI agent from setting prices below the base cost. Comparative evaluation results demonstrate that the DDQN agent achieved a highly stable convergence, generating a maximum cumulative profit of IDR 11,146,669. This proposed model significantly outperformed the static pricing baseline (IDR 3,975,383) and the conventional Q-Learning algorithm (IDR 9,966,507). These findings prove the robustness of the proposed DDQN architecture in safely, precisely, and automatically exploiting continuous market inelasticity without relying on manual interventions.

Zitieren

APA

Mahendra, N., & Rahardi, M. (2026). E-Commerce Dynamic Pricing Optimization Using Double Deep Q-Network and Reward Shaping. Journal of Information System Exploration and Research, 4(4), 451-462. https://doi.org/10.52465/joiser.v4i4.90

Vancouver

Mahendra N, Rahardi M. E-Commerce Dynamic Pricing Optimization Using Double Deep Q-Network and Reward Shaping. Journal of Information System Exploration and Research. 2026;4(4):451-462. doi:10.52465/joiser.v4i4.90

BibTeX
@article{Mahendra2026,
  author = {Mahendra, NAZAL and Rahardi, Majid},
  title = {E-Commerce Dynamic Pricing Optimization Using Double Deep Q-Network and Reward Shaping},
  journal = {Journal of Information System Exploration and Research},
  year = {2026},
  volume = {4},
  number = {4},
  pages = {451--462},
  doi = {10.52465/joiser.v4i4.90}
}
Kostenlos starten →