EUVIMEDEUVIMED entdecken
Crossref

Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts

Yi Jiang, Weinan Gao, Ci Chen, Tianyou Chai, Frank L. Lewis

SIAM Journal on Control and Optimization · 31.10.2023 · 61 (5) · 3183-3208

DOI: 10.1137/21m1438797 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SIAM Journal on Control and Optimization, online erschienen am 24.10.2023. Verfasst von Yi Jiang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: Hong Kong Special Administrative Region, Marcus Wallenbergs Stiftelse för Internationellt Vetenskapligt Samarbete, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper investigates the adaptive optimal control problem and proposes fundamentally novel non-model-based approaches for linear discrete-time networked control systems (NCSs) with both sensor and actuator two-channel stochastic dropouts by using directly the data transmitted via communication networks. First, we formulate a modified algebraic Riccati equation parameterized by the system dynamics and the network-induced packet dropouts probabilities, whose solvability is related to a critical arrival probability. To deal with this problem, two model-based reinforcement learning algorithms, policy iteration (PI) and value iteration (VI), are designed with their convergence proofs. To enable the application for NCSs with unknown system dynamics, two novel online PI and VI algorithms are designed. These algorithms develop a new theoretical framework to solve the Bellman function with stochastic dropouts by using directly the data transmitted via networks. Furthermore, a bilevel learning algorithm is proposed to approximate the critical arrival probability. Last but not least, an extension of the developed online VI algorithm is presented for stochastic systems with both unmeasurable noises and stochastic dropouts.

Förderung

  • Hong Kong Special Administrative Region
  • Marcus Wallenbergs Stiftelse för Internationellt Vetenskapligt Samarbete
  • National Natural Science Foundation of China

Zitieren

APA

Jiang, Y., Gao, W., Chen, C., Chai, T., & Lewis, F. L. (2023). Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts. SIAM Journal on Control and Optimization, 61(5), 3183-3208. https://doi.org/10.1137/21m1438797

Vancouver

Jiang Y, Gao W, Chen C, Chai T, Lewis FL. Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts. SIAM Journal on Control and Optimization. 2023;61(5):3183-3208. doi:10.1137/21m1438797

BibTeX
@article{Jiang2023,
  author = {Jiang, Yi and Gao, Weinan and Chen, Ci and Chai, Tianyou and Lewis, Frank L.},
  title = {Adaptive Optimal Control of Linear Discrete-Time Networked Control Systems with Two-Channel Stochastic Dropouts},
  journal = {SIAM Journal on Control and Optimization},
  year = {2023},
  volume = {61},
  number = {5},
  pages = {3183--3208},
  doi = {10.1137/21m1438797}
}
Kostenlos starten →