TD3-Based Reinforcement Learning for Adaptive PID-like Control of Uncertain Dynamical Systems
Mathematics · 19.05.2026 · 14 (10) · 1744
DOI: 10.3390/math14101744 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 19.05.2026. Verfasst von Ufuk Demircioğlu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University.
Abstract (Originalsprache)
This paper presents a TD3-based reinforcement learning framework for adaptive PID-like control of uncertain dynamical systems. Although proportional–integral–derivative (PID) control remains widely used because of its simplicity, interpretability, and practical effectiveness, fixed-gain PID controllers often experience performance degradation in the presence of external disturbances, parameter variations, and changing operating conditions. To address this limitation, the control task is formulated as a continuous-action reinforcement learning problem in which the observation vector is constructed from PID-related error components, namely the tracking error, its integral, and its derivative. Based on these error-derived observations, a Twin Delayed Deep Deterministic Policy Gradient (TD3) agent learns a bounded continuous control policy through interaction with the environment while preserving a PID-like structural interpretation. The proposed framework is evaluated on a representative mass–spring–damper system under three challenging scenarios: external disturbance, parametric uncertainty, and their simultaneous presence. Its performance is further examined for both constant-reference regulation and sinusoidal reference tracking. The simulation results show that the learned controller achieves stable and accurate tracking, fast transient response, and robust behavior across varying operating conditions. These findings demonstrate the potential of TD3-based reinforcement learning as an effective adaptive PID-like control strategy for uncertain dynamical systems.
Förderung
- Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University
Zitieren
APA
Demircioğlu, U., Bakır, H., Almarri, B., & Hafez, A. H. A. (2026). TD3-Based Reinforcement Learning for Adaptive PID-like Control of Uncertain Dynamical Systems. Mathematics, 14(10), 1744. https://doi.org/10.3390/math14101744
Vancouver
Demircioğlu U, Bakır H, Almarri B, Hafez AHA. TD3-Based Reinforcement Learning for Adaptive PID-like Control of Uncertain Dynamical Systems. Mathematics. 2026;14(10):1744. doi:10.3390/math14101744
BibTeX
@article{Demirciolu2026,
author = {Demircioğlu, Ufuk and Bakır, Halit and Almarri, Badar and Hafez, A. H. Abdul},
title = {TD3-Based Reinforcement Learning for Adaptive PID-like Control of Uncertain Dynamical Systems},
journal = {Mathematics},
year = {2026},
volume = {14},
number = {10},
pages = {1744},
doi = {10.3390/math14101744}
}
EUVIMED