EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Path Planning in Sparse Reward Environments: A DQN Approach with Adaptive Reward Shaping and Curriculum Learning

Hongyi Yang, Bo Cai, Yunlong Li

Algorithms · 21.01.2026 · 19 (1) · 89

DOI: 10.3390/a19010089 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Algorithms, online erschienen am 21.01.2026. Verfasst von Hongyi Yang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep reinforcement learning (DRL) has shown great potential in path planning tasks. However, in sparse reward environments, DRL still faces significant challenges such as low training efficiency and a tendency to converge to suboptimal policies. Traditional reward shaping methods can partially alleviate these issues, but they typically rely on hand-crafted designs, which often introduce complex reward coupling, make hyperparameter tuning difficult, and limit generalization capability. To address these challenges, this paper proposes Curriculum-guided Learning with Adaptive Reward Shaping for Deep Q-Network (CLARS-DQN), a path planning algorithm that integrates Adaptive Reward Shaping (ARS) and Curriculum Learning (CL). The algorithm consists of two key components: (1) ARS-DQN, which augments the DQN framework with a learnable intrinsic reward function to reduce reward sparsity and dependence on expert knowledge; and (2) a curriculum strategy that guides policy optimization through a staged training process, progressing from simple to complex tasks to enhance generalization. Training also incorporates Prioritized Experience Replay (PER) to improve sample efficiency and training stability. CLARS-DQN outperforms baseline methods in task success rate, path quality, training efficiency, and hyperparameter robustness. In unseen environments, the method improves task success rate and average path length by 12% and 26%, respectively, demonstrating strong generalization. Ablation studies confirm the critical contribution of each module.

Zitieren

APA

Yang, H., Cai, B., & Li, Y. (2026). Path Planning in Sparse Reward Environments: A DQN Approach with Adaptive Reward Shaping and Curriculum Learning. Algorithms, 19(1), 89. https://doi.org/10.3390/a19010089

Vancouver

Yang H, Cai B, Li Y. Path Planning in Sparse Reward Environments: A DQN Approach with Adaptive Reward Shaping and Curriculum Learning. Algorithms. 2026;19(1):89. doi:10.3390/a19010089

BibTeX
@article{Yang2026,
  author = {Yang, Hongyi and Cai, Bo and Li, Yunlong},
  title = {Path Planning in Sparse Reward Environments: A DQN Approach with Adaptive Reward Shaping and Curriculum Learning},
  journal = {Algorithms},
  year = {2026},
  volume = {19},
  number = {1},
  pages = {89},
  doi = {10.3390/a19010089}
}
Kostenlos starten →