International Journal of Control, Automation, and Systems 2024; 22(8): 2472-2482
https://doi.org/10.1007/s12555-023-0727-6
© The International Journal of Control, Automation, and Systems
In this paper, the optimal backstepping control method based on game theory is designed for strict feedback nonlinear systems with input saturation. In order to improve the robustness of the system, the zero-sum game problem of control input and disturbance for strict feedback systems is studied in this paper. Specifically, reinforcement learning (RL) is used to obtain the Nash equilibrium solution of the subsystem corresponding to the virtual control input and the virtual disturbance based on the HJB equation. By using the recursive process of backstepping, the controller of the tracking game problem between the control input and the disturbance of the high-order system is designed. In addition, according to the Lyapunov stability theory, it is proved that all internal signals of the closed-loop systems are uniformly ultimately bounded (UUB). Finally, simulation results are provided to illustrate the validity of the proposed method.
Keywords Game-based backstepping, input constraints, neural networks (NNs), optimal control, strict-feedback system.
International Journal of Control, Automation, and Systems 2024; 22(8): 2472-2482
Published online August 1, 2024 https://doi.org/10.1007/s12555-023-0727-6
Copyright © The International Journal of Control, Automation, and Systems.
Liuliu Zhang*, Hailong Jing, Cheng Qian, and Changchun Hua
Yanshan University
In this paper, the optimal backstepping control method based on game theory is designed for strict feedback nonlinear systems with input saturation. In order to improve the robustness of the system, the zero-sum game problem of control input and disturbance for strict feedback systems is studied in this paper. Specifically, reinforcement learning (RL) is used to obtain the Nash equilibrium solution of the subsystem corresponding to the virtual control input and the virtual disturbance based on the HJB equation. By using the recursive process of backstepping, the controller of the tracking game problem between the control input and the disturbance of the high-order system is designed. In addition, according to the Lyapunov stability theory, it is proved that all internal signals of the closed-loop systems are uniformly ultimately bounded (UUB). Finally, simulation results are provided to illustrate the validity of the proposed method.
Keywords: Game-based backstepping, input constraints, neural networks (NNs), optimal control, strict-feedback system.
Vol. 22, No. 9, pp. 2673~2953
Zhihui Wu*, Guo-Ping Liu, June Hu, Hui Yu, and Dongyan Chen
International Journal of Control, Automation, and Systems 2024; 22(9): 2699-2710Jianfeng Wang, Yan Wang*, and Zhicheng Ji
International Journal of Control, Automation, and Systems 2024; 22(8): 2444-2454Zikang Li, Deqing Huang, and Liangcheng Cai*
International Journal of Control, Automation, and Systems 2024; 22(3): 753-764