A Homotopy Method for Continuous-Time Model-Free LQR Control Based on Policy Iteration
IEEE/CAA Journal of Automatica Sinica · 2025-08 · 12 (8) · 1673-1682
DOI: 10.1109/jas.2025.125132 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE/CAA Journal of Automatica Sinica, 2025-08. Verfasst von Wenwu Fan und 1 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
In recent years, reinforcement learning control theory has been well developed. However, model-free value iteration needs many iterations to achieve the desired precision, and model-free policy iteration requires an initial stabilizing control policy. It is significant to propose a fast model-free algorithm to solve the continuous-time linear quadratic control problem without an initial stabilizing control policy. In this paper, we construct a homotopy path on which each point corresponds to an linear quadratic regulator problem. Based on policy iteration, model-based and model-free homotopy algorithms are proposed to solve the optimal control problem of continuous-time linear systems along the homotopy path. Our algorithms are speeded up using first-order differential information and do not require an initial stabilizing control policy. Finally, several practical examples are used to illustrate our results.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Fan, W., & Xiong, J. (2025). A Homotopy Method for Continuous-Time Model-Free LQR Control Based on Policy Iteration. IEEE/CAA Journal of Automatica Sinica, 12(8), 1673-1682. https://doi.org/10.1109/jas.2025.125132
Vancouver
Fan W, Xiong J. A Homotopy Method for Continuous-Time Model-Free LQR Control Based on Policy Iteration. IEEE/CAA Journal of Automatica Sinica. 2025;12(8):1673-1682. doi:10.1109/jas.2025.125132
BibTeX
@article{Fan2025,
author = {Fan, Wenwu and Xiong, Junlin},
title = {A Homotopy Method for Continuous-Time Model-Free LQR Control Based on Policy Iteration},
journal = {IEEE/CAA Journal of Automatica Sinica},
year = {2025},
volume = {12},
number = {8},
pages = {1673--1682},
doi = {10.1109/jas.2025.125132}
}
EUVIMED