Regular Papers

International Journal of Control, Automation, and Systems 2025; 23(3): 896-906

https://doi.org/10.1007/s12555-024-0213-9

© The International Journal of Control, Automation, and Systems

Enhanced Hydraulic Excavator Control via Semi-automatic Grading Control Using Reinforcement Learning

Youngbum Kim and Jinwhan Kim*

KAIST

Abstract

This paper introduces a novel control approach for automated excavators combining model-based and learning-based techniques to enhance control accuracy. The feedback linearization technique is employed based on error dynamics in designing boom and bucket velocity controllers incorporating the driver’s manual arm control. Additionally, supervised learning is used to approximate inverse hydraulic actuation system and to compute joy stick control inputs corresponding to the desired control velocity. To further refine control precision reinforcement learning is used to optimize the driver’s manual arm manipulation within a given cycle time. The performance of the proposed methodology is demonstrated through simulations on a 30-ton excavator and compared with results based on model-based techniques.

Keywords Excavator, feedback linearization, intervention, inverse hydraulic actuation, reinforcement learning, semi-automatic grading, supervised learning.

Article

Regular Papers

International Journal of Control, Automation, and Systems 2025; 23(3): 896-906

Published online March 1, 2025 https://doi.org/10.1007/s12555-024-0213-9

Copyright © The International Journal of Control, Automation, and Systems.

Enhanced Hydraulic Excavator Control via Semi-automatic Grading Control Using Reinforcement Learning

Youngbum Kim and Jinwhan Kim*

KAIST

Abstract

This paper introduces a novel control approach for automated excavators combining model-based and learning-based techniques to enhance control accuracy. The feedback linearization technique is employed based on error dynamics in designing boom and bucket velocity controllers incorporating the driver’s manual arm control. Additionally, supervised learning is used to approximate inverse hydraulic actuation system and to compute joy stick control inputs corresponding to the desired control velocity. To further refine control precision reinforcement learning is used to optimize the driver’s manual arm manipulation within a given cycle time. The performance of the proposed methodology is demonstrated through simulations on a 30-ton excavator and compared with results based on model-based techniques.

Keywords: Excavator, feedback linearization, intervention, inverse hydraulic actuation, reinforcement learning, semi-automatic grading, supervised learning.

IJCAS
March 2025

Vol. 23, No. 3, pp. 683~972

Stats or Metrics

Share this article on

  • line

Related articles in IJCAS

IJCAS

eISSN 2005-4092
pISSN 1598-6446