EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Optimizing Cascaded Control of Mechatronic Systems through Constrained Residual Reinforcement Learning

Tom Staessens, Tom Lefebvre, Guillaume Crevecoeur

Machines · 20.03.2023 · 11 (3) · 402

DOI: 10.3390/machines11030402 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machines, online erschienen am 20.03.2023. Verfasst von Tom Staessens und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Foundation Flanders (FWO).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Cascaded control structures are prevalent in industrial systems with many disturbances to obtain stable control but are cumbersome and challenging to tune. In this work, we propose cascaded constrained residual reinforcement learning (RL), an intuitive method that allows to improve the performance of a cascaded control structure while maintaining safe operation at all times. We draw inspiration from the constrained residual RL framework, in which a constrained reinforcement learning agent learns corrective adaptations to a base controller’s output to increase optimality. We first revisit the interplay between the residual agent and the baseline controller and subsequently extend this to the cascaded case. We analyze the differences and challenges this structure brings and derive some principle insights from this into the stability and operation of the cascaded residual architecture. Next, we propose a novel actor structure to enable efficient learning under the cascaded setting. We show that the standard algorithm is suboptimal for application to cascaded control structures and validate our method on a high-fidelity simulator of a dual motor drivetrain, resulting in a performance improvement of 14.7% on average, with only a minor decrease in performance occurring during the training phase. We study the different principles constituting the method and examine and validate their contribution to the algorithm’s performance under the considered cascaded control structure.

Förderung

  • Research Foundation Flanders (FWO)

Zitieren

APA

Staessens, T., Lefebvre, T., & Crevecoeur, G. (2023). Optimizing Cascaded Control of Mechatronic Systems through Constrained Residual Reinforcement Learning. Machines, 11(3), 402. https://doi.org/10.3390/machines11030402

Vancouver

Staessens T, Lefebvre T, Crevecoeur G. Optimizing Cascaded Control of Mechatronic Systems through Constrained Residual Reinforcement Learning. Machines. 2023;11(3):402. doi:10.3390/machines11030402

BibTeX
@article{Staessens2023,
  author = {Staessens, Tom and Lefebvre, Tom and Crevecoeur, Guillaume},
  title = {Optimizing Cascaded Control of Mechatronic Systems through Constrained Residual Reinforcement Learning},
  journal = {Machines},
  year = {2023},
  volume = {11},
  number = {3},
  pages = {402},
  doi = {10.3390/machines11030402}
}
Kostenlos starten →