International Journal of Control, Automation, and Systems 2023; 21(10): 3324-3335
https://doi.org/10.1007/s12555-022-0509-6
© The International Journal of Control, Automation, and Systems
The main objective of this paper is to establish a framework to study the co-adaptation between humans and automation systems in a haptic shared control framework. We specifically used this framework to design control transfer strategies between humans and automation systems to resolve a conflict when co-steering a semi-automated ground vehicle. The proposed framework contains three main parts. First, we defined a modular structure to separate partner-specific strategies from task-dependent representations and use this structure to learn different co-adaption strategies. In this structure, we assume the human and automation steering commands can be determined by optimizing cost functions. For each agent, the costs are defined as a combination of a set of hand-coded features and vectors of weights. The hand-coded features can be selected to describe task-dependent representations. On the other hand, the weight distributions over these features can be used as a proxy to determine the partner-specific conventions. Second, to leverage the learned co-adaptation strategies, we developed a map connecting different strategies to the outputs of human-automation interactions by employing a collaborative-competitive game concept. Finally, using the map, we designed an adaptable automation system capable of co-adapting to human driver’s strategies. Specifically, we designed an episode-based policy search using the deep deterministic policy gradients technique to determine the optimal weights vector distribution of automation’s cost function. The simulation results demonstrate that the handover strategies designed based on co-adaption between human and automation systems can successfully resolve a conflict and improve the performance of the human automation teaming.
Keywords Conventions and co-adaption, haptic shared control, human-robot interaction, semi-automated vehicles.
International Journal of Control, Automation, and Systems 2023; 21(10): 3324-3335
Published online October 1, 2023 https://doi.org/10.1007/s12555-022-0509-6
Copyright © The International Journal of Control, Automation, and Systems.
Vahid Izadi and Amir H. Ghasemi*
University of North Carlona at Charlotte
The main objective of this paper is to establish a framework to study the co-adaptation between humans and automation systems in a haptic shared control framework. We specifically used this framework to design control transfer strategies between humans and automation systems to resolve a conflict when co-steering a semi-automated ground vehicle. The proposed framework contains three main parts. First, we defined a modular structure to separate partner-specific strategies from task-dependent representations and use this structure to learn different co-adaption strategies. In this structure, we assume the human and automation steering commands can be determined by optimizing cost functions. For each agent, the costs are defined as a combination of a set of hand-coded features and vectors of weights. The hand-coded features can be selected to describe task-dependent representations. On the other hand, the weight distributions over these features can be used as a proxy to determine the partner-specific conventions. Second, to leverage the learned co-adaptation strategies, we developed a map connecting different strategies to the outputs of human-automation interactions by employing a collaborative-competitive game concept. Finally, using the map, we designed an adaptable automation system capable of co-adapting to human driver’s strategies. Specifically, we designed an episode-based policy search using the deep deterministic policy gradients technique to determine the optimal weights vector distribution of automation’s cost function. The simulation results demonstrate that the handover strategies designed based on co-adaption between human and automation systems can successfully resolve a conflict and improve the performance of the human automation teaming.
Keywords: Conventions and co-adaption, haptic shared control, human-robot interaction, semi-automated vehicles.
Vol. 23, No. 2, pp. 359~682
Joosun Lee, Taeyhang Lim, and Wansoo Kim*
International Journal of Control, Automation, and Systems 2024; 22(7): 2263-2272Jinuk Heo, Hyelim Choi, Yongseok Lee, Hyunsu Kim, Harim Ji, Hyunreal Park, Youngseon Lee, Cheongkee Jung, Hai-Nguyen Nguyen, and Dongjun Lee*
International Journal of Control, Automation, and Systems 2024; 22(6): 1761-1778Amos Alwala*, Haitham El-Hussieny, Abdelfatah Mohamed, Kiyotaka Iwasaki, and Samy F. M. Assal
2023; 21(6): 1978-1992