Enhancing Stability and Performance in Mobile Robot Path Planning with PMR-Dueling DQN Algorithm
Sensors · 27.02.2024 · 24 (5) · 1523
DOI: 10.3390/s24051523 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 27.02.2024. Verfasst von Demelash Abiye Deguale und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Central South University, Changsha 410083, China. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Hunan Province, Natural Science Foundation of China.
Abstract (Originalsprache)
Path planning for mobile robots in complex circumstances is still a challenging issue. This work introduces an improved deep reinforcement learning strategy for robot navigation that combines dueling architecture, Prioritized Experience Replay, and shaped Rewards. In a grid world and two Gazebo simulation environments with static and dynamic obstacles, the Dueling Deep Q-Network with Modified Rewards and Prioritized Experience Replay (PMR-Dueling DQN) algorithm is compared against Q-learning, DQN, and DDQN in terms of path optimality, collision avoidance, and learning speed. To encourage the best routes, the shaped Reward function takes into account target direction, obstacle avoidance, and distance. Prioritized replay concentrates training on important events while a dueling architecture separates value and advantage learning. The results show that the PMR-Dueling DQN has greatly increased convergence speed, stability, and overall performance across conditions. In both grid world and Gazebo environments the PMR-Dueling DQN achieved higher cumulative rewards. The combination of deep reinforcement learning with reward design, network architecture, and experience replay enables the PMR-Dueling DQN to surpass traditional approaches for robot path planning in complex environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Automation, Central South University, Changsha 410083, China.
- School of Computer Science and Engineering, Central South University, Changsha 410083, China.
ORCID-Profile: Demelash Abiye Deguale, Lingli Yu, Melikamu Liyih Sinishaw
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Hunan Province
- Natural Science Foundation of China
Zitieren
APA
Deguale, D. A., Yu, L., Sinishaw, M. L., & Li, K. (2024). Enhancing Stability and Performance in Mobile Robot Path Planning with PMR-Dueling DQN Algorithm. Sensors, 24(5), 1523. https://doi.org/10.3390/s24051523
Vancouver
Deguale DA, Yu L, Sinishaw ML, Li K. Enhancing Stability and Performance in Mobile Robot Path Planning with PMR-Dueling DQN Algorithm. Sensors. 2024;24(5):1523. doi:10.3390/s24051523
BibTeX
@article{Deguale2024,
author = {Deguale, Demelash Abiye and Yu, Lingli and Sinishaw, Melikamu Liyih and Li, Keyi},
title = {Enhancing Stability and Performance in Mobile Robot Path Planning with PMR-Dueling DQN Algorithm},
journal = {Sensors},
year = {2024},
volume = {24},
number = {5},
pages = {1523},
doi = {10.3390/s24051523}
}
EUVIMED