Fully cooperative games with state and input constraints using reinforcement learning based on control barrier functions
Asian Journal of Control · 2024-03 · 26 (2) · 888-905
DOI: 10.1002/asjc.3226 ↗Kurz gefasst
Fachartikel in der Zeitschrift Asian Journal of Control, online erschienen am 07.09.2023. Verfasst von Shihan Liu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: Fundamental Research Funds for the Central Universities, National Natural Science Foundation of China.
Abstract (Originalsprache)
This paper provides a novel safe reinforcement learning (RL) control algorithm to solve safe optimal problems for fully cooperative (FC) games of discrete‐time multiplayer nonlinear systems with state and input constraints. The FC game is a special case of nonzero‐sum (NZS) games, where all players cooperate to accomplish a common task. The algorithm is proposed based on the policy iteration (PI) framework utilizing only the measured data along the system trajectories in the environment. Different from most works about PI, an effective method of obtaining initial safe and stable control policies is given here. In addition, control barrier functions (CBFs) and an input constraint function are introduced to augment reward functions. And the monotonically nonincreasing property of the iterative value function in the PI algorithm maintains the safe set forward invariant. Then, the neural networks are employed to approximate the system dynamics, the iterative control policies, and the iterative value function, respectively. Furthermore, the proposed algorithm is supported by theoretical proofs that guarantee both safety and convergence. Finally, the effectiveness and safety of the algorithm are illustrated by the results of the simulation.
Förderung
- Fundamental Research Funds for the Central Universities
- National Natural Science Foundation of China
Zitieren
APA
Liu, S., Liu, L., & Yu, Z. (2024). Fully cooperative games with state and input constraints using reinforcement learning based on control barrier functions. Asian Journal of Control, 26(2), 888-905. https://doi.org/10.1002/asjc.3226
Vancouver
Liu S, Liu L, Yu Z. Fully cooperative games with state and input constraints using reinforcement learning based on control barrier functions. Asian Journal of Control. 2024;26(2):888-905. doi:10.1002/asjc.3226
BibTeX
@article{Liu2024,
author = {Liu, Shihan and Liu, Lijun and Yu, Zhen},
title = {Fully cooperative games with state and input constraints using reinforcement learning based on control barrier functions},
journal = {Asian Journal of Control},
year = {2024},
volume = {26},
number = {2},
pages = {888--905},
doi = {10.1002/asjc.3226}
}
EUVIMED