State estimation and optimal control of an inverted pendulum on a cart system with stochastic approximation approach
Applied Computing and Intelligence · 2023
DOI: 10.3934/aci.2023005 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Computing and Intelligence, 2023. Verfasst von Xian Wen Sim und 2 weiteren Autor:innen. Die Arbeit nennt 17 Literaturangaben.
Abstract (Originalsprache)
In this paper, optimal control of an inverted pendulum on a cart system is studied. Since the nonlinear structure of the system is complex, and in the presence of random disturbances, optimization and control of the motion of the system become more challenging. For handling this system, a discrete-time stochastic optimal control problem for the system is described, where the external force is considered as the control input. By defining a loss function, namely, the mean squared errors to be minimized, the stochastic approximation (SA) approach is applied to estimate the state dynamics. In addition, the Hamiltonian function is defined, and the first-order necessary conditions are derived. The gradient of the cost function is determined so that the SA approach is employed to update the control sequences. For illustration, considering the values of the related parameters in the system, the discrete-time stochastic optimal control problem is solved iteratively by using the SA algorithm. The simulation results show that the state estimation and the optimal control law design are well performed with the SA algorithm, and the motion of the inverted pendulum cart is addressed satisfactorily. In conclusion, the efficiency of the SA approach for solving the inverted pendulum on a cart system is verified.
Zitieren
APA
Sim, X. W., Kek, S. L., & Sim, S. Y. (2023). State estimation and optimal control of an inverted pendulum on a cart system with stochastic approximation approach. Applied Computing and Intelligence. https://doi.org/10.3934/aci.2023005
Vancouver
Sim XW, Kek SL, Sim SY. State estimation and optimal control of an inverted pendulum on a cart system with stochastic approximation approach. Applied Computing and Intelligence. 2023. doi:10.3934/aci.2023005
BibTeX
@article{Sim2023,
author = {Sim, Xian Wen and Kek, Sie Long and Sim, Sy Yi},
title = {State estimation and optimal control of an inverted pendulum on a cart system with stochastic approximation approach},
journal = {Applied Computing and Intelligence},
year = {2023},
doi = {10.3934/aci.2023005}
}
EUVIMED