Reinforcement Q-learning optimal control of 2D discrete-time systems with unknown dynamics
Transactions of the Institute of Measurement and Control · 17.04.2026
DOI: 10.1177/01423312261440722 ↗Kurz gefasst
Fachartikel in der Zeitschrift Transactions of the Institute of Measurement and Control, online erschienen am 17.04.2026. Verfasst von Wei Wu und 5 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Gefördert von: national natural science foundation of china.
Abstract (Originalsprache)
This paper proposes a Q-learning-based algorithm to solve the linear quadratic regulator (LQR) problem for unknown dynamic two-dimensional (2D) discrete-time systems. First, based on the value function formulation constructed using the Lyapunov function framework, algebraic Riccati inequality (ARI) and the Bellman inequality for solving the LQR problem are derived. Subsequently, a suboptimal state feedback controller is obtained based on these inequalities, and an offline policy iteration algorithm based on semi-definite programming (SDP) is introduced. On this foundation, by introducing the concept of Q-learning, the objective function and the Bellman inequality are transformed into the Q-function and its corresponding inequality. A Q-learning-based offline policy iteration equation is then derived, and further, an online policy iteration algorithm based on Q-learning is designed. Data are collected online during each iteration to solve the LQR problem for 2D discrete systems with unknown dynamics. Finally, the effectiveness of the proposed control scheme is validated through two examples.
Förderung
- national natural science foundation of china
Zitieren
APA
Wu, W., Yan, J., Lin, W., Zhang, Z., Zeng, G., & Huang, S. (2026). Reinforcement Q-learning optimal control of 2D discrete-time systems with unknown dynamics. Transactions of the Institute of Measurement and Control. https://doi.org/10.1177/01423312261440722
Vancouver
Wu W, Yan J, Lin W, Zhang Z, Zeng G, Huang S. Reinforcement Q-learning optimal control of 2D discrete-time systems with unknown dynamics. Transactions of the Institute of Measurement and Control. 2026. doi:10.1177/01423312261440722
BibTeX
@article{Wu2026,
author = {Wu, Wei and Yan, Jin and Lin, Wei and Zhang, Zhengjiang and Zeng, Guoqiang and Huang, Shipei},
title = {Reinforcement Q-learning optimal control of 2D discrete-time systems with unknown dynamics},
journal = {Transactions of the Institute of Measurement and Control},
year = {2026},
doi = {10.1177/01423312261440722}
}
EUVIMED