Regular Paper

International Journal of Control, Automation and Systems 2013; 11(3): 496-502

Published online June 15, 2013

https://doi.org/10.1007/s12555-011-0243-y

© The International Journal of Control, Automation, and Systems

Wavelet Reduced Order Observer based Adaptive Tracking Control for a Class of Uncertain Nonlinear Systems using Reinforcement Learning

Manish Sharma and Ajay Verma

Rajiv Gandhi Technical University

Abstract

This Paper investigates the mean to design the reduced order observer and observer based controllers for a class of uncertain nonlinear system using reinforcement learning. A new design approach of wavelet based adaptive reduced order observer is proposed. The proposed wavelet adaptive reduced order observer performs the task of identification of unknown system dynamics in addition to the reconstruction of states of the system. Reinforcement learning is used via two wavelet neural networks (WNN), critic WNN and action WNN, which are combined to form an adaptive WNN controller. The “strategic” utility function is approximated by the critic WNN and is minimized by the action WNN. Owing to their superior learning capabilities, wavelet networks are employed in this work for the purpose of identification of unknown system dynamics. Using the feedback control, based on re-constructed states, the behavior of closed loop system is investigated. By Lyapunov approach, the uni-formly ultimate boundedness of the closed-loop tracking error is verified. A numerical example is pro-vided to verify the effectiveness of theoretical development.

Keywords Adaptive control, Lyapunov functional, optimal control, reduced order observer, reinforce-ment learning, Wavelet neural networks.

Article

Regular Paper

International Journal of Control, Automation and Systems 2013; 11(3): 496-502

Published online June 1, 2013 https://doi.org/10.1007/s12555-011-0243-y

Copyright © The International Journal of Control, Automation, and Systems.

Wavelet Reduced Order Observer based Adaptive Tracking Control for a Class of Uncertain Nonlinear Systems using Reinforcement Learning

Manish Sharma and Ajay Verma

Rajiv Gandhi Technical University

Abstract

This Paper investigates the mean to design the reduced order observer and observer based controllers for a class of uncertain nonlinear system using reinforcement learning. A new design approach of wavelet based adaptive reduced order observer is proposed. The proposed wavelet adaptive reduced order observer performs the task of identification of unknown system dynamics in addition to the reconstruction of states of the system. Reinforcement learning is used via two wavelet neural networks (WNN), critic WNN and action WNN, which are combined to form an adaptive WNN controller. The “strategic” utility function is approximated by the critic WNN and is minimized by the action WNN. Owing to their superior learning capabilities, wavelet networks are employed in this work for the purpose of identification of unknown system dynamics. Using the feedback control, based on re-constructed states, the behavior of closed loop system is investigated. By Lyapunov approach, the uni-formly ultimate boundedness of the closed-loop tracking error is verified. A numerical example is pro-vided to verify the effectiveness of theoretical development.

Keywords: Adaptive control, Lyapunov functional, optimal control, reduced order observer, reinforce-ment learning, Wavelet neural networks.

IJCAS
July 2024

Vol. 22, No. 7, pp. 2055~2340

Stats or Metrics

Share this article on

  • line

Related articles in IJCAS

IJCAS

eISSN 2005-4092
pISSN 1598-6446