Regular Papers

International Journal of Control, Automation and Systems 2018; 16(5): 2393-2404

Published online September 13, 2018

https://doi.org/10.1007/s12555-017-0532-1

© The International Journal of Control, Automation, and Systems

Progressive Filtering Approach for Early Human Action Recognition

Tehao Zhu, Yue Zhou, Zeyang Xia*, Jiaqi Dong, and Qunfei Zhao

Shenzhen Institutes of Advanced Technology

Abstract

Human action recognition plays an important role in vision-based human-robot interaction (HRI). In many application scenarios of HRI, robot is required to recognize the human action expressions as early as possible in order to ensure a suitable response. In this paper, we proposed a novel progressive filtering approach to improve the robot’s performance in identifying the ongoing human actions and thus to enhance the fluency and friendliness of HRI. Human movement data were captured by a Kinect device, and then the human actions were constituted by the refined movement data using robust regression-based refinement. Motion primitive, including both spatial and temporal information concerning the movement, was considered as an improved representation of action features. Then, the early human action recognition was accomplished based on an improved locality-sensitive hashing algorithm, by which the ongoing input action can be classified progressively. The proposed approach has been evaluated on four datasets of human actions in terms of accuracy and recall curves. The experiments showed that the proposed progressive filtering approach achieves high recognition rate, and in addition, can make the recognition decision at an earlier stage of the ongoing action."

Keywords Early human action recognition, human-robot interaction, locality-sensitive hashing, motion primitive, progressive filter.

Article

Regular Papers

International Journal of Control, Automation and Systems 2018; 16(5): 2393-2404

Published online October 1, 2018 https://doi.org/10.1007/s12555-017-0532-1

Copyright © The International Journal of Control, Automation, and Systems.

Progressive Filtering Approach for Early Human Action Recognition

Tehao Zhu, Yue Zhou, Zeyang Xia*, Jiaqi Dong, and Qunfei Zhao

Shenzhen Institutes of Advanced Technology

Abstract

Human action recognition plays an important role in vision-based human-robot interaction (HRI). In many application scenarios of HRI, robot is required to recognize the human action expressions as early as possible in order to ensure a suitable response. In this paper, we proposed a novel progressive filtering approach to improve the robot’s performance in identifying the ongoing human actions and thus to enhance the fluency and friendliness of HRI. Human movement data were captured by a Kinect device, and then the human actions were constituted by the refined movement data using robust regression-based refinement. Motion primitive, including both spatial and temporal information concerning the movement, was considered as an improved representation of action features. Then, the early human action recognition was accomplished based on an improved locality-sensitive hashing algorithm, by which the ongoing input action can be classified progressively. The proposed approach has been evaluated on four datasets of human actions in terms of accuracy and recall curves. The experiments showed that the proposed progressive filtering approach achieves high recognition rate, and in addition, can make the recognition decision at an earlier stage of the ongoing action."

Keywords: Early human action recognition, human-robot interaction, locality-sensitive hashing, motion primitive, progressive filter.

IJCAS
March 2025

Vol. 23, No. 3, pp. 683~972

Stats or Metrics

Share this article on

  • line

Related articles in IJCAS

IJCAS

eISSN 2005-4092
pISSN 1598-6446