EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TD3-Based Reinforcement Learning for Adaptive PID-like Control of Uncertain Dynamical Systems

Ufuk Demircioğlu, Halit Bakır, Badar Almarri, A. H. Abdul Hafez

Mathematics · 19.05.2026 · 14 (10) · 1744

DOI: 10.3390/math14101744 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 19.05.2026. Verfasst von Ufuk Demircioğlu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a TD3-based reinforcement learning framework for adaptive PID-like control of uncertain dynamical systems. Although proportional–integral–derivative (PID) control remains widely used because of its simplicity, interpretability, and practical effectiveness, fixed-gain PID controllers often experience performance degradation in the presence of external disturbances, parameter variations, and changing operating conditions. To address this limitation, the control task is formulated as a continuous-action reinforcement learning problem in which the observation vector is constructed from PID-related error components, namely the tracking error, its integral, and its derivative. Based on these error-derived observations, a Twin Delayed Deep Deterministic Policy Gradient (TD3) agent learns a bounded continuous control policy through interaction with the environment while preserving a PID-like structural interpretation. The proposed framework is evaluated on a representative mass–spring–damper system under three challenging scenarios: external disturbance, parametric uncertainty, and their simultaneous presence. Its performance is further examined for both constant-reference regulation and sinusoidal reference tracking. The simulation results show that the learned controller achieves stable and accurate tracking, fast transient response, and robust behavior across varying operating conditions. These findings demonstrate the potential of TD3-based reinforcement learning as an effective adaptive PID-like control strategy for uncertain dynamical systems.

Förderung

  • Deanship of Scientific Research, Vice Presidency for Graduate Studies and Scientific Research, King Faisal University

Zitieren

APA

Demircioğlu, U., Bakır, H., Almarri, B., & Hafez, A. H. A. (2026). TD3-Based Reinforcement Learning for Adaptive PID-like Control of Uncertain Dynamical Systems. Mathematics, 14(10), 1744. https://doi.org/10.3390/math14101744

Vancouver

Demircioğlu U, Bakır H, Almarri B, Hafez AHA. TD3-Based Reinforcement Learning for Adaptive PID-like Control of Uncertain Dynamical Systems. Mathematics. 2026;14(10):1744. doi:10.3390/math14101744

BibTeX
@article{Demirciolu2026,
  author = {Demircioğlu, Ufuk and Bakır, Halit and Almarri, Badar and Hafez, A. H. Abdul},
  title = {TD3-Based Reinforcement Learning for Adaptive PID-like Control of Uncertain Dynamical Systems},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {10},
  pages = {1744},
  doi = {10.3390/math14101744}
}
Kostenlos starten →