GCR-RL: Gradient Control Reward Shaping for Reinforcement Learning
IEEE Access · 2026 · 14 · 122677-122690
DOI: 10.1109/access.2026.3721879 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Anas Aburaya und 5 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Universiti Teknologi Malaysia.
Abstract (Originalsprache)
Designing an optimal reward function is fundamental to achieving stability and efficiency in reinforcement learning (RL). This is particularly critical in robotics, where sparse rewards often provide insufficient guidance, necessitating the inclusion of auxiliary state information to facilitate meaningful exploration. This work introduces Gradient Control Rewards (GCR), an interpretable, control-inspired reward-design methodology for accelerating agent training by modulating the reward signal based on the temporal dynamics of system error. Inspired by classical control theory, GCR partitions the reward into three distinct components, state alignment, bias correction, and dynamic stability. These elements synergistically discourage the accumulation of error and excessive velocity toward objectives, facilitating the acquisition of a well-regulated action policy. GCR was evaluated across diverse environments, ranging from simple pendulum simulations to high-fidelity robotic scenarios and external physical validation. Experimental results demonstrate that GCR achieves competitive performance compared to both conventional reward functions and adaptive methods such as Bootstrapped Reward Shaping (BSRS). While alternative approaches exhibit performance degradation in stochastic, real-world-representative simulations, GCR maintains robustness and has been successfully validated in external physical environments. These findings suggest that GCR offers a practical and interpretable framework for deploying RL in control-oriented physical systems.
Förderung
- Universiti Teknologi Malaysia
Zitieren
APA
Aburaya, A., Selamat, H., Muslim, M. T., Abdullahi, A. M., Rashid, R. A., & Hing, T. H. (2026). GCR-RL: Gradient Control Reward Shaping for Reinforcement Learning. IEEE Access, 14, 122677-122690. https://doi.org/10.1109/access.2026.3721879
Vancouver
Aburaya A, Selamat H, Muslim MT, Abdullahi AM, Rashid RA, Hing TH. GCR-RL: Gradient Control Reward Shaping for Reinforcement Learning. IEEE Access. 2026;14:122677-122690. doi:10.1109/access.2026.3721879
BibTeX
@article{Aburaya2026,
author = {Aburaya, Anas and Selamat, Hazlina and Muslim, Mohd Taufiq and Abdullahi, Auwalu M. and Rashid, Rozeha A. and Hing, Tang Howe},
title = {GCR-RL: Gradient Control Reward Shaping for Reinforcement Learning},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {122677--122690},
doi = {10.1109/access.2026.3721879}
}
EUVIMED