International Journal of Control, Automation and Systems 2018; 16(5): 2393-2404
Published online September 13, 2018
https://doi.org/10.1007/s12555-017-0532-1
© The International Journal of Control, Automation, and Systems
Human action recognition plays an important role in vision-based human-robot interaction (HRI). In many application scenarios of HRI, robot is required to recognize the human action expressions as early as possible in order to ensure a suitable response. In this paper, we proposed a novel progressive filtering approach to improve the robot’s performance in identifying the ongoing human actions and thus to enhance the fluency and friendliness of HRI. Human movement data were captured by a Kinect device, and then the human actions were constituted by the refined movement data using robust regression-based refinement. Motion primitive, including both spatial and temporal information concerning the movement, was considered as an improved representation of action features. Then, the early human action recognition was accomplished based on an improved locality-sensitive hashing algorithm, by which the ongoing input action can be classified progressively. The proposed approach has been evaluated on four datasets of human actions in terms of accuracy and recall curves. The experiments showed that the proposed progressive filtering approach achieves high recognition rate, and in addition, can make the recognition decision at an earlier stage of the ongoing action."
Keywords Early human action recognition, human-robot interaction, locality-sensitive hashing, motion primitive, progressive filter.
International Journal of Control, Automation and Systems 2018; 16(5): 2393-2404
Published online October 1, 2018 https://doi.org/10.1007/s12555-017-0532-1
Copyright © The International Journal of Control, Automation, and Systems.
Tehao Zhu, Yue Zhou, Zeyang Xia*, Jiaqi Dong, and Qunfei Zhao
Shenzhen Institutes of Advanced Technology
Human action recognition plays an important role in vision-based human-robot interaction (HRI). In many application scenarios of HRI, robot is required to recognize the human action expressions as early as possible in order to ensure a suitable response. In this paper, we proposed a novel progressive filtering approach to improve the robot’s performance in identifying the ongoing human actions and thus to enhance the fluency and friendliness of HRI. Human movement data were captured by a Kinect device, and then the human actions were constituted by the refined movement data using robust regression-based refinement. Motion primitive, including both spatial and temporal information concerning the movement, was considered as an improved representation of action features. Then, the early human action recognition was accomplished based on an improved locality-sensitive hashing algorithm, by which the ongoing input action can be classified progressively. The proposed approach has been evaluated on four datasets of human actions in terms of accuracy and recall curves. The experiments showed that the proposed progressive filtering approach achieves high recognition rate, and in addition, can make the recognition decision at an earlier stage of the ongoing action."
Keywords: Early human action recognition, human-robot interaction, locality-sensitive hashing, motion primitive, progressive filter.
Vol. 23, No. 3, pp. 683~972
Joosun Lee, Taeyhang Lim, and Wansoo Kim*
International Journal of Control, Automation, and Systems 2024; 22(7): 2263-2272Jinuk Heo, Hyelim Choi, Yongseok Lee, Hyunsu Kim, Harim Ji, Hyunreal Park, Youngseon Lee, Cheongkee Jung, Hai-Nguyen Nguyen, and Dongjun Lee*
International Journal of Control, Automation, and Systems 2024; 22(6): 1761-1778Vahid Izadi and Amir H. Ghasemi*
International Journal of Control, Automation, and Systems 2023; 21(10): 3324-3335