Regular Papers

International Journal of Control, Automation and Systems 2020; 18(5): 1116-1127

Published online December 26, 2019

https://doi.org/10.1007/s12555-019-0165-7

© The International Journal of Control, Automation, and Systems

Optimal Guaranteed Cost Tracking of Uncertain Nonlinear Systems Using Adaptive Dynamic Programming with Concurrent Learning

Dengguo Xu, Qinglin Wang, and Yuan Li*

Beijing Institute of Technology

Abstract

In this paper, based on adaptive dynamic programming (ADP) with concurrent learning, the problem of optimal guaranteed cost tracking is studied for a class of uncertain continuous-time nonlinear systems. First, the original uncertain system and a reference system are combined into an augmented uncertain system, and the performance index is transformed into the corresponding augmented form. Afterwards, the solution of the optimal control problem consisting of the nominal augmented system with the modified performance index is proven to be the optimal guaranteed cost tracking control law of the original uncertain system. Moreover, a concurrent learning tuning algorithm based on ADP is presented to approximate the solution of corresponding Hamilton-Jacobi-Bellman (HJB) equation, which relaxes the condition of persistent excitation (PE). A neural network-based approximate optimal guaranteed cost tracking design is developed not only to ensure tracking error convergence to zero for all admissible uncertainties but also to achieve the minimal guaranteed cost. Finally, two simulation examples are considered to verify the effectiveness of the theoretical results.

Keywords Adaptive dynamic programming, concurrent learning, optimal control, optimal guaranteed cost tracking, uncertain nonlinear system

Article

Regular Papers

International Journal of Control, Automation and Systems 2020; 18(5): 1116-1127

Published online May 1, 2020 https://doi.org/10.1007/s12555-019-0165-7

Copyright © The International Journal of Control, Automation, and Systems.

Optimal Guaranteed Cost Tracking of Uncertain Nonlinear Systems Using Adaptive Dynamic Programming with Concurrent Learning

Dengguo Xu, Qinglin Wang, and Yuan Li*

Beijing Institute of Technology

Abstract

In this paper, based on adaptive dynamic programming (ADP) with concurrent learning, the problem of optimal guaranteed cost tracking is studied for a class of uncertain continuous-time nonlinear systems. First, the original uncertain system and a reference system are combined into an augmented uncertain system, and the performance index is transformed into the corresponding augmented form. Afterwards, the solution of the optimal control problem consisting of the nominal augmented system with the modified performance index is proven to be the optimal guaranteed cost tracking control law of the original uncertain system. Moreover, a concurrent learning tuning algorithm based on ADP is presented to approximate the solution of corresponding Hamilton-Jacobi-Bellman (HJB) equation, which relaxes the condition of persistent excitation (PE). A neural network-based approximate optimal guaranteed cost tracking design is developed not only to ensure tracking error convergence to zero for all admissible uncertainties but also to achieve the minimal guaranteed cost. Finally, two simulation examples are considered to verify the effectiveness of the theoretical results.

Keywords: Adaptive dynamic programming, concurrent learning, optimal control, optimal guaranteed cost tracking, uncertain nonlinear system

IJCAS
May 2024

Vol. 22, No. 5, pp. 1461~1759

Stats or Metrics

Share this article on

  • line

Related articles in IJCAS

IJCAS

eISSN 2005-4092
pISSN 1598-6446