EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhanced Q-Learning for Grid Navigation: Direction-Sensitive Priors, Annealed Exploration, and Potential-Based Reward Optimization

Yi Tang, Yuliya German

Informatics and Automation · 03.07.2026 · 25 (4) · 1235-1259

DOI: 10.15622/ia.25.4.9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Informatics and Automation, online erschienen am 03.07.2026. Verfasst von Yi Tang und 1 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

his paper presents an enhanced Q-learning framework specifically designed for grid navigation in environments with obstacles. Building upon the foundation of standard tabular Q-learning, we propose three pivotal improvements: a direction-sensitive Q-table initialization method that achieves goal alignment without requiring prior knowledge of obstacles; an annealed Boltzmann exploration strategy augmented with upper confidence bound terms to facilitate balanced and adaptive sampling; and a potential-based continuous reward shaping function to deliver denser feedback and accelerate the learning process. These enhancements address common challenges in sparse-reward settings, such as inefficient exploration and sluggish value propagation. Experimental evaluations conducted on randomly generated grids demonstrate that, compared to baseline methods such as standard Q-learning and its variants, our approach achieves higher success rates, shorter optimal path lengths, and faster convergence speeds. By preserving the model-free generality of Q-learning while enhancing sample efficiency, this framework proves well-suited for practical applications in robotics and path planning domains.

Zitieren

APA

Tang, Y., & German, Y. (2026). Enhanced Q-Learning for Grid Navigation: Direction-Sensitive Priors, Annealed Exploration, and Potential-Based Reward Optimization. Informatics and Automation, 25(4), 1235-1259. https://doi.org/10.15622/ia.25.4.9

Vancouver

Tang Y, German Y. Enhanced Q-Learning for Grid Navigation: Direction-Sensitive Priors, Annealed Exploration, and Potential-Based Reward Optimization. Informatics and Automation. 2026;25(4):1235-1259. doi:10.15622/ia.25.4.9

BibTeX
@article{Tang2026,
  author = {Tang, Yi and German, Yuliya},
  title = {Enhanced Q-Learning for Grid Navigation: Direction-Sensitive Priors, Annealed Exploration, and Potential-Based Reward Optimization},
  journal = {Informatics and Automation},
  year = {2026},
  volume = {25},
  number = {4},
  pages = {1235--1259},
  doi = {10.15622/ia.25.4.9}
}
Kostenlos starten →