EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reinforcement Learning for Warehouse Management Using a Scenario-Based Simulation Testbed

Laura Acosta García, Julen Cestero Portu, Ander García Gangoiti, Marco Quartulli

AI · 08.08.2026 · 7 (8) · 308

DOI: 10.3390/ai7080308 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AI, online erschienen am 08.08.2026. Verfasst von Laura Acosta García und 3 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union’s Horizon Europe research and innovation programme.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Warehouse operations involve dynamic item flows, fluctuating demand, and heterogeneous layouts, making adaptive decision-making essential for efficient storage and order fulfillment. In this context, reinforcement learning (RL) provides a promising approach for learning adaptive warehouse control policies under stochastic environments. However, evaluating RL-based solutions in real warehouse settings is often costly and time-consuming, motivating the need for realistic and reproducible simulation environments. In this paper, we introduce a configurable warehouse simulation environment modeling stochastic item arrivals, order generation, and internal logistics operations across diverse layouts and workload conditions. Based on this environment, we construct a reproducible experimental testbed composed of multiple scenarios ranging from low-load to highly congested settings. The testbed is publicly released to support reproducible research and comparative evaluation within the research community. We formulate the warehouse management problem as a Markov decision process (MDP) and apply a Maskable Proximal Policy Optimization (Maskable PPO) agent to learn adaptive control policies. The RL-based approach is evaluated across the defined scenarios and compared against heuristic baseline strategies. Experimental results show that the proposed solution achieves performance comparable to a strong greedy first-in, first-out (FIFO) heuristic while improving order fulfillment by up to 13.5 percentage points under challenging workload conditions. These results demonstrate the ability of RL to learn robust warehouse control policies that adaptively optimize performance and maintain operational stability across a wide spectrum of distinct scenarios.

Förderung

  • European Union’s Horizon Europe research and innovation programme

Zitieren

APA

García, L. A., Portu, J. C., Gangoiti, A. G., & Quartulli, M. (2026). Reinforcement Learning for Warehouse Management Using a Scenario-Based Simulation Testbed. AI, 7(8), 308. https://doi.org/10.3390/ai7080308

Vancouver

García LA, Portu JC, Gangoiti AG, Quartulli M. Reinforcement Learning for Warehouse Management Using a Scenario-Based Simulation Testbed. AI. 2026;7(8):308. doi:10.3390/ai7080308

BibTeX
@article{Garca2026,
  author = {García, Laura Acosta and Portu, Julen Cestero and Gangoiti, Ander García and Quartulli, Marco},
  title = {Reinforcement Learning for Warehouse Management Using a Scenario-Based Simulation Testbed},
  journal = {AI},
  year = {2026},
  volume = {7},
  number = {8},
  pages = {308},
  doi = {10.3390/ai7080308}
}
Kostenlos starten →