TY - JOUR
T1 - Complicated robot activity recognition by quality-aware deep reinforcement learning
AU - Li, Xing
AU - Zhong, Junpei
AU - Kamruzzaman, M. M.
N1 - Funding Information:
Xing Li was born in 1982. She received the Dr. Eng. degree in Power electronics and power transmission from Northeast University. She is currently an associate professor with the School of Electrical Engineering & Intelligentization, Dongguan University of Technology, Guangdong, China. A number of research results has gained the support of the National Natural Science Fund and Liaoning Natural Science Fund. She is also the member of the Big Data Committee and Process Control Committee for the Chinese Association of Automation. Her current research interests include adaptive/robust control, motion control, Intelligent robot system, etc.
Funding Information:
This work was supported by National Natural Science Foundation of China (Grant: 61873054 and 61503070 ) and Jouf university, Sakaka, Al-Jouf, KSA .
Publisher Copyright:
© 2020 Elsevier B.V.
PY - 2021/4
Y1 - 2021/4
N2 - Automatic robot activity understanding plays an important role in human–computer interaction (HCI), especially in smart home service robots. Existing manipulator control methods, such as position control, vision-based control method, fail to meet the requirements of autonomous learning. Reinforcement learning can cope with the interaction of robot control and environment; however, the method should relearn the control method when the position of target object changes. To solve this problem, this paper proposes a quality model to utilize deep reinforcement learning scheme to achieve an end-to-end manipulator control. Specifically, we design a policy search algorithm to achieve automatic learning of manipulator. To avoid relearning of manipulator, we design convolutional neural network control scheme to remain the robustness of manipulator. Extensive experiment has shown the effectiveness of our proposed method.
AB - Automatic robot activity understanding plays an important role in human–computer interaction (HCI), especially in smart home service robots. Existing manipulator control methods, such as position control, vision-based control method, fail to meet the requirements of autonomous learning. Reinforcement learning can cope with the interaction of robot control and environment; however, the method should relearn the control method when the position of target object changes. To solve this problem, this paper proposes a quality model to utilize deep reinforcement learning scheme to achieve an end-to-end manipulator control. Specifically, we design a policy search algorithm to achieve automatic learning of manipulator. To avoid relearning of manipulator, we design convolutional neural network control scheme to remain the robustness of manipulator. Extensive experiment has shown the effectiveness of our proposed method.
KW - Deep reinforcement learning
KW - End-to-end learning
KW - Human–computer interaction
KW - Policy search
KW - Quality model
UR - http://www.scopus.com/inward/record.url?scp=85098736997&partnerID=8YFLogxK
U2 - 10.1016/j.future.2020.11.017
DO - 10.1016/j.future.2020.11.017
M3 - Journal article
AN - SCOPUS:85098736997
SN - 0167-739X
VL - 117
SP - 480
EP - 485
JO - Future Generation Computer Systems
JF - Future Generation Computer Systems
ER -