Regular Papers

International Journal of Control, Automation and Systems 2023; 21(7): 2162-2174

Published online July 11, 2023

https://doi.org/10.1007/s12555-022-0149-x

© The International Journal of Control, Automation, and Systems

Optimal Control and Stabilization for Discrete-time Markov Jump Systems With Indefinite Weight Costs and Multi-channel Multiplicative Noises

Song Zhang, Chunyan Han*, and Wei Wang

University of Jinan

Abstract

This paper is concerned with the optimal control and stabilization problems for discrete-time Markov jump systems with multi-channel multiplicative noises. The weight matrices in the cost function can be indefinite. The necessary and sufficient existence conditions for the optimal controller in the finite horizon is proposed explicitly in terms of generalized difference Riccati equations. Further, via the finite horizon optimal cost, we define a Lyapunov function to reduce the indefinite stabilization problem to a definite one. And in the infinite horizon, the necessary and sufficient condition to stabilize the Markov jump linear system in the mean-square sense is presented. Moreover, we prove that the Markov jump linear system is mean-square stabilizable if and only if the generalized coupled algebraic Riccati equation has a solution. Simultaneously, this solution is the maximal solution to the generalized coupled algebraic Riccati equations.

Keywords Markov jump linear system, multiplicative noise, optimal control, Riccati equation, stabilization.

Article

Regular Papers

International Journal of Control, Automation and Systems 2023; 21(7): 2162-2174

Published online July 1, 2023 https://doi.org/10.1007/s12555-022-0149-x

Copyright © The International Journal of Control, Automation, and Systems.

Optimal Control and Stabilization for Discrete-time Markov Jump Systems With Indefinite Weight Costs and Multi-channel Multiplicative Noises

Song Zhang, Chunyan Han*, and Wei Wang

University of Jinan

Abstract

This paper is concerned with the optimal control and stabilization problems for discrete-time Markov jump systems with multi-channel multiplicative noises. The weight matrices in the cost function can be indefinite. The necessary and sufficient existence conditions for the optimal controller in the finite horizon is proposed explicitly in terms of generalized difference Riccati equations. Further, via the finite horizon optimal cost, we define a Lyapunov function to reduce the indefinite stabilization problem to a definite one. And in the infinite horizon, the necessary and sufficient condition to stabilize the Markov jump linear system in the mean-square sense is presented. Moreover, we prove that the Markov jump linear system is mean-square stabilizable if and only if the generalized coupled algebraic Riccati equation has a solution. Simultaneously, this solution is the maximal solution to the generalized coupled algebraic Riccati equations.

Keywords: Markov jump linear system, multiplicative noise, optimal control, Riccati equation, stabilization.

IJCAS
March 2025

Vol. 23, No. 3, pp. 683~972

Stats or Metrics

Share this article on

  • line

Related articles in IJCAS

IJCAS

eISSN 2005-4092
pISSN 1598-6446