EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Hybrid Planning–Learning Framework for Autonomous Navigation with Dynamic Obstacles

Hatice Arslan Öztürk, Sırma Yavuz, Çetin Kaya Koç

Applied Sciences · 19.03.2026 · 16 (6) · 2961

DOI: 10.3390/app16062961 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 19.03.2026. Verfasst von Hatice Arslan Öztürk und 2 weiteren Autor:innen. Die Arbeit nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: TÜBİTAK, Jiangsu Province 100 Foreign Experts Plan.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional navigation methods work well in known, static environments but degrade in real-world settings with dynamic and unpredictable obstacles. This paper presents Double Deep Q-Network with A* guidance (DDQNA), a hybrid navigation algorithm that enables an agent to traverse mazes containing static and dynamic obstacles while maintaining a low probability of collision. DDQNA combines A* guidance with Double Deep Q-Network (DDQN) learning using an ϵ-greedy policy, and it introduces a redesigned reward function and an improved action-selection mechanism to better exploit A*’s directional cues during training. We evaluate DDQNA in a custom Pygame simulation across 11 environments of increasing difficulty. Experimental results show that DDQNA consistently outperforms the standard DDQN and other state-of-the-art reinforcement learning baselines, achieving higher goal-reaching rates, fewer visited cells, shorter computation times, and higher cumulative rewards. These results indicate that DDQNA provides both effective navigation and computational efficiency in complex environments with static and dynamic obstacles.

Förderung

  • TÜBİTAK
  • Jiangsu Province 100 Foreign Experts Plan

Zitieren

APA

Öztürk, H. A., Yavuz, S., & Koç, Ç. K. (2026). A Hybrid Planning–Learning Framework for Autonomous Navigation with Dynamic Obstacles. Applied Sciences, 16(6), 2961. https://doi.org/10.3390/app16062961

Vancouver

Öztürk HA, Yavuz S, Koç ÇK. A Hybrid Planning–Learning Framework for Autonomous Navigation with Dynamic Obstacles. Applied Sciences. 2026;16(6):2961. doi:10.3390/app16062961

BibTeX
@article{ztrk2026,
  author = {Öztürk, Hatice Arslan and Yavuz, Sırma and Koç, Çetin Kaya},
  title = {A Hybrid Planning–Learning Framework for Autonomous Navigation with Dynamic Obstacles},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {6},
  pages = {2961},
  doi = {10.3390/app16062961}
}
Kostenlos starten →