Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning
Sensors · 15.06.2023 · 23 (12) · 5615
DOI: 10.3390/s23125615 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 15.06.2023. Verfasst von Xianfeng Ye und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China. Hauptthemen laut MEDLINE: Learning, Reward. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Technology of the People's Republic of China, National Key R&D Program of China.
Abstract (Originalsprache)
This paper presents a multi-agent reinforcement learning (MARL) algorithm to address the scheduling and routing problems of multiple automated guided vehicles (AGVs), with the goal of minimizing overall energy consumption. The proposed algorithm is developed based on the multi-agent deep deterministic policy gradient (MADDPG) algorithm, with modifications made to the action and state space to fit the setting of AGV activities. While previous studies overlooked the energy efficiency of AGVs, this paper develops a well-designed reward function that helps to optimize the overall energy consumption required to fulfill all tasks. Moreover, we incorporate the e-greedy exploration strategy into the proposed algorithm to balance exploration and exploitation during training, which helps it converge faster and achieve better performance. The proposed MARL algorithm is equipped with carefully selected parameters that aid in avoiding obstacles, speeding up path planning, and achieving minimal energy consumption. To demonstrate the effectiveness of the proposed algorithm, three types of numerical experiments including the ϵ-greedy MADDPG, MADDPG, and Q-Learning methods were conducted. The results show that the proposed algorithm can effectively solve the multi-AGV task assignment and path planning problems, and the energy consumption results show that the planned routes can effectively improve energy efficiency.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China.
- Department of Mechanical Engineering, Dalian University of Technology, Dalian 116023, China.
ORCID-Profile: Xianfeng Ye, Weiming Shen
Förderung
- Ministry of Science and Technology of the People's Republic of China
- National Key R&D Program of China
Zitieren
APA
Ye, X., Deng, Z., Shi, Y., & Shen, W. (2023). Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning. Sensors, 23(12), 5615. https://doi.org/10.3390/s23125615
Vancouver
Ye X, Deng Z, Shi Y, Shen W. Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning. Sensors. 2023;23(12):5615. doi:10.3390/s23125615
BibTeX
@article{Ye2023,
author = {Ye, Xianfeng and Deng, Zhiyun and Shi, Yanjun and Shen, Weiming},
title = {Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning},
journal = {Sensors},
year = {2023},
volume = {23},
number = {12},
pages = {5615},
doi = {10.3390/s23125615}
}
EUVIMED