International Journal of Control, Automation and Systems 2023; 21(7): 2162-2174
Published online July 11, 2023
https://doi.org/10.1007/s12555-022-0149-x
© The International Journal of Control, Automation, and Systems
This paper is concerned with the optimal control and stabilization problems for discrete-time Markov jump systems with multi-channel multiplicative noises. The weight matrices in the cost function can be indefinite. The necessary and sufficient existence conditions for the optimal controller in the finite horizon is proposed explicitly in terms of generalized difference Riccati equations. Further, via the finite horizon optimal cost, we define a Lyapunov function to reduce the indefinite stabilization problem to a definite one. And in the infinite horizon, the necessary and sufficient condition to stabilize the Markov jump linear system in the mean-square sense is presented. Moreover, we prove that the Markov jump linear system is mean-square stabilizable if and only if the generalized coupled algebraic Riccati equation has a solution. Simultaneously, this solution is the maximal solution to the generalized coupled algebraic Riccati equations.
Keywords Markov jump linear system, multiplicative noise, optimal control, Riccati equation, stabilization.
International Journal of Control, Automation and Systems 2023; 21(7): 2162-2174
Published online July 1, 2023 https://doi.org/10.1007/s12555-022-0149-x
Copyright © The International Journal of Control, Automation, and Systems.
Song Zhang, Chunyan Han*, and Wei Wang
University of Jinan
This paper is concerned with the optimal control and stabilization problems for discrete-time Markov jump systems with multi-channel multiplicative noises. The weight matrices in the cost function can be indefinite. The necessary and sufficient existence conditions for the optimal controller in the finite horizon is proposed explicitly in terms of generalized difference Riccati equations. Further, via the finite horizon optimal cost, we define a Lyapunov function to reduce the indefinite stabilization problem to a definite one. And in the infinite horizon, the necessary and sufficient condition to stabilize the Markov jump linear system in the mean-square sense is presented. Moreover, we prove that the Markov jump linear system is mean-square stabilizable if and only if the generalized coupled algebraic Riccati equation has a solution. Simultaneously, this solution is the maximal solution to the generalized coupled algebraic Riccati equations.
Keywords: Markov jump linear system, multiplicative noise, optimal control, Riccati equation, stabilization.
Vol. 23, No. 3, pp. 683~972
Xueyang Li, Chunyan Han*, Juanjuan Xu, and Wei Wang
International Journal of Control, Automation, and Systems 2024; 22(1): 93-105Chein-Chung Sun, Ping-Tzan Huang*, Cheung-Chieh Ku, and Kuan-Wei Huang
International Journal of Control, Automation, and Systems 2025; 23(3): 692-703Chenguang Wu* and Yanjun Shen
International Journal of Control, Automation, and Systems 2025; 23(1): 162-174