EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Stability and Performance in Mobile Robot Path Planning with PMR-Dueling DQN Algorithm

Demelash Abiye Deguale iD, Lingli Yu iD, Melikamu Liyih Sinishaw iD, Keyi Li

Sensors · 27.02.2024 · 24 (5) · 1523

DOI: 10.3390/s24051523 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 27.02.2024. Verfasst von Demelash Abiye Deguale und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Central South University, Changsha 410083, China. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Hunan Province, Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Path planning for mobile robots in complex circumstances is still a challenging issue. This work introduces an improved deep reinforcement learning strategy for robot navigation that combines dueling architecture, Prioritized Experience Replay, and shaped Rewards. In a grid world and two Gazebo simulation environments with static and dynamic obstacles, the Dueling Deep Q-Network with Modified Rewards and Prioritized Experience Replay (PMR-Dueling DQN) algorithm is compared against Q-learning, DQN, and DDQN in terms of path optimality, collision avoidance, and learning speed. To encourage the best routes, the shaped Reward function takes into account target direction, obstacle avoidance, and distance. Prioritized replay concentrates training on important events while a dueling architecture separates value and advantage learning. The results show that the PMR-Dueling DQN has greatly increased convergence speed, stability, and overall performance across conditions. In both grid world and Gazebo environments the PMR-Dueling DQN achieved higher cumulative rewards. The combination of deep reinforcement learning with reward design, network architecture, and experience replay enables the PMR-Dueling DQN to surpass traditional approaches for robot path planning in complex environments.

Schlagwörter

Stichwörter der Autor:innen

dueling networkmobile robotpath planningprioritized experience replayreinforcement learning

Autor:innen und Institutionen

  • School of Automation, Central South University, Changsha 410083, China.
  • School of Computer Science and Engineering, Central South University, Changsha 410083, China.

ORCID-Profile: Demelash Abiye Deguale, Lingli Yu, Melikamu Liyih Sinishaw

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Hunan Province
  • Natural Science Foundation of China

Zitieren

APA

Deguale, D. A., Yu, L., Sinishaw, M. L., & Li, K. (2024). Enhancing Stability and Performance in Mobile Robot Path Planning with PMR-Dueling DQN Algorithm. Sensors, 24(5), 1523. https://doi.org/10.3390/s24051523

Vancouver

Deguale DA, Yu L, Sinishaw ML, Li K. Enhancing Stability and Performance in Mobile Robot Path Planning with PMR-Dueling DQN Algorithm. Sensors. 2024;24(5):1523. doi:10.3390/s24051523

BibTeX
@article{Deguale2024,
  author = {Deguale, Demelash Abiye and Yu, Lingli and Sinishaw, Melikamu Liyih and Li, Keyi},
  title = {Enhancing Stability and Performance in Mobile Robot Path Planning with PMR-Dueling DQN Algorithm},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {5},
  pages = {1523},
  doi = {10.3390/s24051523}
}
Kostenlos starten →