Regular Papers

International Journal of Control, Automation and Systems 2022; 20(10): 3347-3360

Published online September 30, 2022

https://doi.org/10.1007/s12555-021-0280-0

© The International Journal of Control, Automation, and Systems

Human-robot Collision Detection Based on the Improved Camshift Algorithm and Bounding Box

Shuangning Lu, Zhouda Xu, and Binrui Wang*

China Jiliang University

Abstract

Aiming at the problem of collision detection and collision point information evaluation in the process of human-robot collaboration, the binocular camera is used as an external sensor to observe. Collision detection is realized by tracking the motion of human-robot through the color information of joints. Firstly, the Camshift algorithm is used to track the position of the manipulator joints and the human arm joints based on the color information. In order to solve the factors that may cause target loss during tracking process, such as shelter and background color similar problems, Kalman filter is integrated on the basis of Camshift algorithm. A similarity threshold is set to judge whether there is interference in the tracking process. The tracking experiment proved that the Kalman filter is effective and enhances the robustness of the tracking algorithm. Secondly, a bounding box collision detection method based on space domain is designed. The sphere bounding box and the cylindrical bounding box is used as the human-robot bounding boxes. The equations of the distance between different boxes are derived and the position of the collision point on the manipulator is calculated. Finally, an experimental environment is built for verification. The distance error of the collision is within 0-10 mm, and the position error between the calculated collision point and the pre-determined collision point is within 10%.

Keywords Collaborative robot, collision detection, human-robot distance, target tracking.

Article

Regular Papers

International Journal of Control, Automation and Systems 2022; 20(10): 3347-3360

Published online October 1, 2022 https://doi.org/10.1007/s12555-021-0280-0

Copyright © The International Journal of Control, Automation, and Systems.

Human-robot Collision Detection Based on the Improved Camshift Algorithm and Bounding Box

Shuangning Lu, Zhouda Xu, and Binrui Wang*

China Jiliang University

Abstract

Aiming at the problem of collision detection and collision point information evaluation in the process of human-robot collaboration, the binocular camera is used as an external sensor to observe. Collision detection is realized by tracking the motion of human-robot through the color information of joints. Firstly, the Camshift algorithm is used to track the position of the manipulator joints and the human arm joints based on the color information. In order to solve the factors that may cause target loss during tracking process, such as shelter and background color similar problems, Kalman filter is integrated on the basis of Camshift algorithm. A similarity threshold is set to judge whether there is interference in the tracking process. The tracking experiment proved that the Kalman filter is effective and enhances the robustness of the tracking algorithm. Secondly, a bounding box collision detection method based on space domain is designed. The sphere bounding box and the cylindrical bounding box is used as the human-robot bounding boxes. The equations of the distance between different boxes are derived and the position of the collision point on the manipulator is calculated. Finally, an experimental environment is built for verification. The distance error of the collision is within 0-10 mm, and the position error between the calculated collision point and the pre-determined collision point is within 10%.

Keywords: Collaborative robot, collision detection, human-robot distance, target tracking.

IJCAS
March 2025

Vol. 23, No. 3, pp. 683~972

Stats or Metrics

Share this article on

  • line

Related articles in IJCAS

IJCAS

eISSN 2005-4092
pISSN 1598-6446