Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts
SIAM Journal on Control and Optimization · 31.10.2023 · 61 (5) · 3183-3208
DOI: 10.1137/21m1438797 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Control and Optimization, online erschienen am 24.10.2023. Verfasst von Yi Jiang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: Hong Kong Special Administrative Region, Marcus Wallenbergs Stiftelse för Internationellt Vetenskapligt Samarbete, National Natural Science Foundation of China.
Abstract (Originalsprache)
This paper investigates the adaptive optimal control problem and proposes fundamentally novel non-model-based approaches for linear discrete-time networked control systems (NCSs) with both sensor and actuator two-channel stochastic dropouts by using directly the data transmitted via communication networks. First, we formulate a modified algebraic Riccati equation parameterized by the system dynamics and the network-induced packet dropouts probabilities, whose solvability is related to a critical arrival probability. To deal with this problem, two model-based reinforcement learning algorithms, policy iteration (PI) and value iteration (VI), are designed with their convergence proofs. To enable the application for NCSs with unknown system dynamics, two novel online PI and VI algorithms are designed. These algorithms develop a new theoretical framework to solve the Bellman function with stochastic dropouts by using directly the data transmitted via networks. Furthermore, a bilevel learning algorithm is proposed to approximate the critical arrival probability. Last but not least, an extension of the developed online VI algorithm is presented for stochastic systems with both unmeasurable noises and stochastic dropouts.
Förderung
- Hong Kong Special Administrative Region
- Marcus Wallenbergs Stiftelse för Internationellt Vetenskapligt Samarbete
- National Natural Science Foundation of China
Zitieren
APA
Jiang, Y., Gao, W., Chen, C., Chai, T., & Lewis, F. L. (2023). Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts. SIAM Journal on Control and Optimization, 61(5), 3183-3208. https://doi.org/10.1137/21m1438797
Vancouver
Jiang Y, Gao W, Chen C, Chai T, Lewis FL. Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts. SIAM Journal on Control and Optimization. 2023;61(5):3183-3208. doi:10.1137/21m1438797
BibTeX
@article{Jiang2023,
author = {Jiang, Yi and Gao, Weinan and Chen, Ci and Chai, Tianyou and Lewis, Frank L.},
title = {Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts},
journal = {SIAM Journal on Control and Optimization},
year = {2023},
volume = {61},
number = {5},
pages = {3183--3208},
doi = {10.1137/21m1438797}
}
EUVIMED