EUVIMEDEUVIMED entdecken
Crossref

Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function

Yongfeng Lv, Jun Zhao, Rong Li, Xuemei Ren

International Journal of Robust and Nonlinear Control · 2024-04 · 34 (6) · 4234-4251

DOI: 10.1002/rnc.7191 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Robust and Nonlinear Control, online erschienen am 08.01.2024. Verfasst von Yongfeng Lv und 3 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Considering overshoot and chatter caused by the unknown interference, this article studies the adaptive robust optimal controls of continuous‐time (CT) multi‐input systems with an approximate dynamic programming (ADP) based Q‐function scheme. An adaptive integral reinforcement learning (IRL) scheme is proposed to study the optimal solutions of Q‐functions. First, multi‐input value functions are presented, and Nash equilibrium is analyzed. A complex Hamilton–Jacobi–Issacs (HJI) equation is constructed with the multi‐input system and the zero‐sum‐game‐based value function. It is a challenging task to solve the HJI equation for nonlinear system. Thus, A transformation of the HJI equation is constructed as a Q‐function. The neural network (NN) is applied to learn the solution of the transformed Q‐functions based on the adaptive IRL scheme. Moreover, an error information is added to the Q‐function for the issue of insufficient initial incentives to relax the persistent excitation (PE) condition. Simultaneously, an IRL signal of the critic networks is introduced to study the saddle‐point intractable solution, such that the system drift and NN derivatives in the HJI equation are relaxed. The convergence of weight parameters is proved, and the closed‐loop stability of the multi‐system with the proposed IRL Q‐function scheme is analyzed. Finally, a two‐engine driven F‐16 aircraft plant and a nonlinear system are presented to verify the effectiveness of the proposed adaptive IRL Q‐function scheme.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Lv, Y., Zhao, J., Li, R., & Ren, X. (2024). Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function. International Journal of Robust and Nonlinear Control, 34(6), 4234-4251. https://doi.org/10.1002/rnc.7191

Vancouver

Lv Y, Zhao J, Li R, Ren X. Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function. International Journal of Robust and Nonlinear Control. 2024;34(6):4234-4251. doi:10.1002/rnc.7191

BibTeX
@article{Lv2024,
  author = {Lv, Yongfeng and Zhao, Jun and Li, Rong and Ren, Xuemei},
  title = {Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function},
  journal = {International Journal of Robust and Nonlinear Control},
  year = {2024},
  volume = {34},
  number = {6},
  pages = {4234--4251},
  doi = {10.1002/rnc.7191}
}
Kostenlos starten →