Multi‐Agent Reinforcement Learning for Multi‐Robot Warehouse Automation in a 3D Environment Using Unity Game Engine
IET Cyber-Systems and Robotics · 2026-01 · 8 (1)
DOI: 10.1049/csy2.70058 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Cyber-Systems and Robotics, online erschienen am 24.07.2026. Verfasst von Seyed Mohamad Kargar und 2 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Multiagent reinforcement learning (MARL) has emerged as a key enabling technology for intelligent coordination in cyber‐physical robotic systems, such as automated warehouses. However, the effectiveness of MARL in real‐world scenarios is often hindered by challenges, such as sparse reward signals and partial observability, which limit the agents' ability to learn optimal behaviours. In this paper, we propose a novel method to design MARL for warehouse management and implement it within a game engine to facilitate real‐world visualisation for industry users. The contributions of this paper are twofold. First, we introduce temporal attention‐enhanced counterfactual multiagent reinforcement learning (TA‐COMA), a novel method designed to enhance performance in environments with sparse rewards and partial observations by integrating temporal advantages. Second, we propose a new approach to define intermediate rewards in sparse reward environments, exemplified through a warehouse scenario. We also demonstrate, for the first time, the implementation of a multiagent reinforcement learning strategy for warehouse environments within the Unity game engine, utilising the ML‐Agents toolkit. The simulation results demonstrate that intermittent rewards significantly improve learning performance. TA‐COMA consistently achieves higher asymptotic mean cumulative rewards than COMA, PPO and shared experience actor–critic (SEAC). We further show that the variance of the temporal advantage in TA‐COMA is reduced by approximately compared to COMA, improving temporal coherence whilst preserving informative advantage structure and stabilising learning. The Unity platform further enables the creation of a realistic 3D warehouse environment and immersive visualisation of multirobot behaviour using a virtual reality (VR) headset.
Zitieren
APA
Kargar, S. M., Lee, C. K. M., & Asadipour, A. (2026). Multi‐Agent Reinforcement Learning for Multi‐Robot Warehouse Automation in a 3D Environment Using Unity Game Engine. IET Cyber-Systems and Robotics, 8(1). https://doi.org/10.1049/csy2.70058
Vancouver
Kargar SM, Lee CKM, Asadipour A. Multi‐Agent Reinforcement Learning for Multi‐Robot Warehouse Automation in a 3D Environment Using Unity Game Engine. IET Cyber-Systems and Robotics. 2026;8(1). doi:10.1049/csy2.70058
BibTeX
@article{Kargar2026,
author = {Kargar, Seyed Mohamad and Lee, C. K. M. and Asadipour, Ali},
title = {Multi‐Agent Reinforcement Learning for Multi‐Robot Warehouse Automation in a 3D Environment Using Unity Game Engine},
journal = {IET Cyber-Systems and Robotics},
year = {2026},
volume = {8},
number = {1},
doi = {10.1049/csy2.70058}
}
EUVIMED