A Hybrid Pure Pursuit–PID and TD3 Control Framework for Differential-Drive Mobile Robots
IEEE Access · 2026 · 14 · 80817-80838
DOI: 10.1109/access.2026.3691502 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Ufuk Demircioglu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University, Saudi Arabia,.
Abstract (Originalsprache)
In this study, a hybrid control structure that combines classical control methods with reinforcement learning is proposed for target tracking of a differential-drive mobile robot. In the proposed framework, Pure Pursuit–based reference generation and an inner-loop Proportional–Integral–Derivative (PID) controller are integrated with the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm. While the classical Pure Pursuit–PID structure ensures baseline stability and safety, the TD3-based learning component enhances performance by generating corrective torque contributions when classical control becomes insufficient. First, experiments are conducted under nominal system conditions to demonstrate that the proposed approach preserves the fundamental behavior of the classical controller and achieves comparable trajectory-tracking performance. Subsequently, the robustness of the control schemes is evaluated under parametric uncertainties applied to the chassis and wheel masses. Experimental results show that the classical PID-based control structure fails to achieve stable convergence under these uncertainties, whereas the proposed reinforcement learning–enhanced controller consistently reaches the target in a stable and reliable manner across all tested scenarios, achieving a 100% success rate. Quantitative analysis further indicates that the proposed method significantly improves convergence behavior and tracking stability by reducing trajectory deviations and eliminating oscillatory behavior observed in the classical controller. Furthermore, the influence of key learning components—such as minibatch size, replay buffer capacity, optimization algorithm, and network architecture—on control performance is systematically analyzed through a comprehensive ablation study. The results demonstrate that the proposed residual learning approach provides superior stability and robustness, effectively overcoming the practical limitations of classical control methods. Accordingly, this study presents a reliable and generalizable mobile robot control architecture capable of coping with model uncertainties and dynamic variations that are inevitable in real-world applications.
Förderung
- Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University, Saudi Arabia,
Zitieren
APA
Demircioglu, U., Bakir, H., Almarri, B., & Hafez, A. H. A. (2026). A Hybrid Pure Pursuit–PID and TD3 Control Framework for Differential-Drive Mobile Robots. IEEE Access, 14, 80817-80838. https://doi.org/10.1109/access.2026.3691502
Vancouver
Demircioglu U, Bakir H, Almarri B, Hafez AHA. A Hybrid Pure Pursuit–PID and TD3 Control Framework for Differential-Drive Mobile Robots. IEEE Access. 2026;14:80817-80838. doi:10.1109/access.2026.3691502
BibTeX
@article{Demircioglu2026,
author = {Demircioglu, Ufuk and Bakir, Halit and Almarri, Badar and Hafez, A. H. Abdul},
title = {A Hybrid Pure Pursuit–PID and TD3 Control Framework for Differential-Drive Mobile Robots},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {80817--80838},
doi = {10.1109/access.2026.3691502}
}
EUVIMED