EUVIMEDEUVIMED entdecken
Crossref

Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems With Trajectory-Based Initial Control Policy

Jiahui Xu, Jingcheng Wang, Jun Rao, Shunyu Wu, Yanjiu Zhong

IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2024-03 · 54 (3) · 1489-1501

DOI: 10.1109/tsmc.2023.3327450 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2024-03. Verfasst von Jiahui Xu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The policy gradient adaptive dynamic programming (PGADP) technique has gained recognition as an effective approach for optimizing the performance of nonlinear systems. Nonetheless, existing PGADP algorithms often demand a substantial volume of expensive or potentially risky interaction data with the system. Moreover, the utilization of neural networks in these algorithms can result in suboptimal learning efficiency and unstable training procedures. To address these challenges, a novel algorithm, referred to as OptNet-PGADP, has been introduced. This algorithm integrates an initially tailored control policy based on OptNet to tackle the optimization of control problems in discrete-time nonlinear systems. The OptNet-PGADP algorithm operates through a two-step process. Initially, the input–output trajectory of the system is computed using the nonlinear model predictive control (NMPC) method. Subsequently, an initial admissible control policy is acquired through OptNet. This policy is iteratively enhanced using the PGADP algorithm to attain the optimal controller. The resulting closed-loop control policy can be readily deployed in real-time applications. The implementation of the algorithm employs OptNet for the actor network and integrates an experience replay mechanism to bolster the controller’s learning efficiency. Furthermore, a convergence and optimality analysis of the algorithm is included. Simulation and experimental results conducted on two nonlinear systems conclusively demonstrate that the approach outperforms traditional PGADP and NMPC algorithms. These findings underscore the efficacy of OptNet-PGADP in mitigating the constraints of current methods and achieving superior control performance for nonlinear systems.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Xu, J., Wang, J., Rao, J., Wu, S., & Zhong, Y. (2024). Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems With Trajectory-Based Initial Control Policy. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 54(3), 1489-1501. https://doi.org/10.1109/tsmc.2023.3327450

Vancouver

Xu J, Wang J, Rao J, Wu S, Zhong Y. Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems With Trajectory-Based Initial Control Policy. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2024;54(3):1489-1501. doi:10.1109/tsmc.2023.3327450

BibTeX
@article{Xu2024,
  author = {Xu, Jiahui and Wang, Jingcheng and Rao, Jun and Wu, Shunyu and Zhong, Yanjiu},
  title = {Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems With Trajectory-Based Initial Control Policy},
  journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
  year = {2024},
  volume = {54},
  number = {3},
  pages = {1489--1501},
  doi = {10.1109/tsmc.2023.3327450}
}
Kostenlos starten →