Regular Papers

International Journal of Control, Automation and Systems 2023; 21(7): 2398-2408

Published online May 4, 2023

https://doi.org/10.1007/s12555-021-0734-4

© The International Journal of Control, Automation, and Systems

Kernel-based Consensus Control of Multi-agent Systems with Unknown System Dynamics

Wei Wang and Changyang Feng*

Central China Normal University

Abstract

A novel method for optimal consensus control of multi-agent systems (MASs) based on adaptive dynamic programming (ADP) is developed in this paper. Unlike neural networks (NNs) that require manually designed features in value function approximation and may effect the approximation quality. Kernel-based methods are adopted to approximate value functions without predefining the model structure. Moreover, to handle the challenge of unknown or complex system dynamics, a local action-value function is defined and kernel-based methods are used to approximate the local action-value function. Thus, an action dependent heuristic dynamic programming (ADHDP) approach that uses kernel-based local action-value function approximation to achieve the model-free optimal consensus control is developed in this paper. The developed approach learns the system dynamics from historical data and avoids the need for system identification. The effectiveness of the developed approach is demonstrated with two simulation examples.

Keywords Adaptive dynamic programming, consensus control, kernel-based method, multi-agent systems, optimal control.

Article

Regular Papers

International Journal of Control, Automation and Systems 2023; 21(7): 2398-2408

Published online July 1, 2023 https://doi.org/10.1007/s12555-021-0734-4

Copyright © The International Journal of Control, Automation, and Systems.

Kernel-based Consensus Control of Multi-agent Systems with Unknown System Dynamics

Wei Wang and Changyang Feng*

Central China Normal University

Abstract

A novel method for optimal consensus control of multi-agent systems (MASs) based on adaptive dynamic programming (ADP) is developed in this paper. Unlike neural networks (NNs) that require manually designed features in value function approximation and may effect the approximation quality. Kernel-based methods are adopted to approximate value functions without predefining the model structure. Moreover, to handle the challenge of unknown or complex system dynamics, a local action-value function is defined and kernel-based methods are used to approximate the local action-value function. Thus, an action dependent heuristic dynamic programming (ADHDP) approach that uses kernel-based local action-value function approximation to achieve the model-free optimal consensus control is developed in this paper. The developed approach learns the system dynamics from historical data and avoids the need for system identification. The effectiveness of the developed approach is demonstrated with two simulation examples.

Keywords: Adaptive dynamic programming, consensus control, kernel-based method, multi-agent systems, optimal control.

IJCAS
June 2024

Vol. 22, No. 6, pp. 1761~2054

Stats or Metrics

Share this article on

  • line

Related articles in IJCAS

IJCAS

eISSN 2005-4092
pISSN 1598-6446