Enhanced Q-Learning for Grid Navigation: Direction-Sensitive Priors, Annealed Exploration, and Potential-Based Reward Optimization
Informatics and Automation · 03.07.2026 · 25 (4) · 1235-1259
DOI: 10.15622/ia.25.4.9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Informatics and Automation, online erschienen am 03.07.2026. Verfasst von Yi Tang und 1 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
his paper presents an enhanced Q-learning framework specifically designed for grid navigation in environments with obstacles. Building upon the foundation of standard tabular Q-learning, we propose three pivotal improvements: a direction-sensitive Q-table initialization method that achieves goal alignment without requiring prior knowledge of obstacles; an annealed Boltzmann exploration strategy augmented with upper confidence bound terms to facilitate balanced and adaptive sampling; and a potential-based continuous reward shaping function to deliver denser feedback and accelerate the learning process. These enhancements address common challenges in sparse-reward settings, such as inefficient exploration and sluggish value propagation. Experimental evaluations conducted on randomly generated grids demonstrate that, compared to baseline methods such as standard Q-learning and its variants, our approach achieves higher success rates, shorter optimal path lengths, and faster convergence speeds. By preserving the model-free generality of Q-learning while enhancing sample efficiency, this framework proves well-suited for practical applications in robotics and path planning domains.
Zitieren
APA
Tang, Y., & German, Y. (2026). Enhanced Q-Learning for Grid Navigation: Direction-Sensitive Priors, Annealed Exploration, and Potential-Based Reward Optimization. Informatics and Automation, 25(4), 1235-1259. https://doi.org/10.15622/ia.25.4.9
Vancouver
Tang Y, German Y. Enhanced Q-Learning for Grid Navigation: Direction-Sensitive Priors, Annealed Exploration, and Potential-Based Reward Optimization. Informatics and Automation. 2026;25(4):1235-1259. doi:10.15622/ia.25.4.9
BibTeX
@article{Tang2026,
author = {Tang, Yi and German, Yuliya},
title = {Enhanced Q-Learning for Grid Navigation: Direction-Sensitive Priors, Annealed Exploration, and Potential-Based Reward Optimization},
journal = {Informatics and Automation},
year = {2026},
volume = {25},
number = {4},
pages = {1235--1259},
doi = {10.15622/ia.25.4.9}
}
EUVIMED