EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning

Xianfeng Ye iD, Zhiyun Deng, Yanjun Shi, Weiming Shen iD

Sensors · 15.06.2023 · 23 (12) · 5615

DOI: 10.3390/s23125615 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 15.06.2023. Verfasst von Xianfeng Ye und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China. Hauptthemen laut MEDLINE: Learning, Reward. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Technology of the People's Republic of China, National Key R&D Program of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a multi-agent reinforcement learning (MARL) algorithm to address the scheduling and routing problems of multiple automated guided vehicles (AGVs), with the goal of minimizing overall energy consumption. The proposed algorithm is developed based on the multi-agent deep deterministic policy gradient (MADDPG) algorithm, with modifications made to the action and state space to fit the setting of AGV activities. While previous studies overlooked the energy efficiency of AGVs, this paper develops a well-designed reward function that helps to optimize the overall energy consumption required to fulfill all tasks. Moreover, we incorporate the e-greedy exploration strategy into the proposed algorithm to balance exploration and exploitation during training, which helps it converge faster and achieve better performance. The proposed MARL algorithm is equipped with carefully selected parameters that aid in avoiding obstacles, speeding up path planning, and achieving minimal energy consumption. To demonstrate the effectiveness of the proposed algorithm, three types of numerical experiments including the ϵ-greedy MADDPG, MADDPG, and Q-Learning methods were conducted. The results show that the proposed algorithm can effectively solve the multi-AGV task assignment and path planning problems, and the energy consumption results show that the planned routes can effectively improve energy efficiency.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LearningRewardAlgorithmsAutonomous VehiclesPhysical Phenomena

Stichwörter der Autor:innen

automated guided vehiclesenergy consumptionmulti-agent reinforcement learningpath planningtask assignment

Autor:innen und Institutionen

  • School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China.
  • Department of Mechanical Engineering, Dalian University of Technology, Dalian 116023, China.

ORCID-Profile: Xianfeng Ye, Weiming Shen

Förderung

  • Ministry of Science and Technology of the People's Republic of China
  • National Key R&D Program of China

Zitieren

APA

Ye, X., Deng, Z., Shi, Y., & Shen, W. (2023). Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning. Sensors, 23(12), 5615. https://doi.org/10.3390/s23125615

Vancouver

Ye X, Deng Z, Shi Y, Shen W. Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning. Sensors. 2023;23(12):5615. doi:10.3390/s23125615

BibTeX
@article{Ye2023,
  author = {Ye, Xianfeng and Deng, Zhiyun and Shi, Yanjun and Shen, Weiming},
  title = {Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {12},
  pages = {5615},
  doi = {10.3390/s23125615}
}
Kostenlos starten →