EUVIMEDEUVIMED entdecken
Crossref

Reinforcement Q-learning optimal control of 2D discrete-time systems with unknown dynamics

Wei Wu, Jin Yan, Wei Lin, Zhengjiang Zhang, Guoqiang Zeng, Shipei Huang

Transactions of the Institute of Measurement and Control · 17.04.2026

DOI: 10.1177/01423312261440722 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions of the Institute of Measurement and Control, online erschienen am 17.04.2026. Verfasst von Wei Wu und 5 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Gefördert von: national natural science foundation of china.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper proposes a Q-learning-based algorithm to solve the linear quadratic regulator (LQR) problem for unknown dynamic two-dimensional (2D) discrete-time systems. First, based on the value function formulation constructed using the Lyapunov function framework, algebraic Riccati inequality (ARI) and the Bellman inequality for solving the LQR problem are derived. Subsequently, a suboptimal state feedback controller is obtained based on these inequalities, and an offline policy iteration algorithm based on semi-definite programming (SDP) is introduced. On this foundation, by introducing the concept of Q-learning, the objective function and the Bellman inequality are transformed into the Q-function and its corresponding inequality. A Q-learning-based offline policy iteration equation is then derived, and further, an online policy iteration algorithm based on Q-learning is designed. Data are collected online during each iteration to solve the LQR problem for 2D discrete systems with unknown dynamics. Finally, the effectiveness of the proposed control scheme is validated through two examples.

Förderung

  • national natural science foundation of china

Zitieren

APA

Wu, W., Yan, J., Lin, W., Zhang, Z., Zeng, G., & Huang, S. (2026). Reinforcement Q-learning optimal control of 2D discrete-time systems with unknown dynamics. Transactions of the Institute of Measurement and Control. https://doi.org/10.1177/01423312261440722

Vancouver

Wu W, Yan J, Lin W, Zhang Z, Zeng G, Huang S. Reinforcement Q-learning optimal control of 2D discrete-time systems with unknown dynamics. Transactions of the Institute of Measurement and Control. 2026. doi:10.1177/01423312261440722

BibTeX
@article{Wu2026,
  author = {Wu, Wei and Yan, Jin and Lin, Wei and Zhang, Zhengjiang and Zeng, Guoqiang and Huang, Shipei},
  title = {Reinforcement Q-learning optimal control of 2D discrete-time systems with unknown dynamics},
  journal = {Transactions of the Institute of Measurement and Control},
  year = {2026},
  doi = {10.1177/01423312261440722}
}
Kostenlos starten →