EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Hybrid Reinforcement Learning Framework Combining TD3 and PID Control for Robust Trajectory Tracking of a 5-DOF Robotic Arm

Zied Ben Hazem, Firas Saidi, Nivine Guler, Ali Husain Altaif

Automation · 14.10.2025 · 6 (4) · 56

DOI: 10.3390/automation6040056 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Automation, online erschienen am 14.10.2025. Verfasst von Zied Ben Hazem und 3 weiteren Autor:innen. Die Arbeit wurde bisher 42-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a hybrid reinforcement learning framework for trajectory tracking control of a 5-degree-of-freedom (DOF) Mitsubishi RV-2AJ robotic arm by integrating model-free deep reinforcement learning (DRL) algorithms with classical control strategies. A novel hybrid PID + TD3 agent is proposed, combining a Proportional–Integral–Derivative (PID) controller with the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, and is compared against standalone TD3 and PID controllers. In this architecture, the PID controller provides baseline stability and deterministic disturbance rejection, while the TD3 agent learns residual corrections to enhance tracking accuracy, robustness, and control smoothness. The robotic system is modeled in MATLAB/Simulink with Simscape Multibody, and the agents are trained using a reward function inspired by artificial potential fields, promoting energy-efficient and precise motion. Extensive simulations are performed under internal disturbances (e.g., joint friction variations, payload changes) and external disturbances (e.g., unexpected forces, environmental interactions). Results demonstrate that the hybrid PID + TD3 approach outperforms both standalone TD3 and PID controllers in convergence speed, tracking precision, and disturbance rejection. This study highlights the effectiveness of combining reinforcement learning with classical control for intelligent, robust, and resilient robotic manipulation in uncertain environments.

Zitieren

APA

Hazem, Z. B., Saidi, F., Guler, N., & Altaif, A. H. (2025). A Hybrid Reinforcement Learning Framework Combining TD3 and PID Control for Robust Trajectory Tracking of a 5-DOF Robotic Arm. Automation, 6(4), 56. https://doi.org/10.3390/automation6040056

Vancouver

Hazem ZB, Saidi F, Guler N, Altaif AH. A Hybrid Reinforcement Learning Framework Combining TD3 and PID Control for Robust Trajectory Tracking of a 5-DOF Robotic Arm. Automation. 2025;6(4):56. doi:10.3390/automation6040056

BibTeX
@article{Hazem2025,
  author = {Hazem, Zied Ben and Saidi, Firas and Guler, Nivine and Altaif, Ali Husain},
  title = {A Hybrid Reinforcement Learning Framework Combining TD3 and PID Control for Robust Trajectory Tracking of a 5-DOF Robotic Arm},
  journal = {Automation},
  year = {2025},
  volume = {6},
  number = {4},
  pages = {56},
  doi = {10.3390/automation6040056}
}
Kostenlos starten →