TY - GEN
T1 - Robotic Tracking Control with Kernel Trick-based Reinforcement Learning
AU - Hu, Yazhou
AU - Wang, Wenxue
AU - Liu, Hao
AU - Liu, Lianqing
N1 - Funding Information:
This work was supported in part by National Key R&D Program of China (Grant No. 2016YFE0206200), and in part by Key R&D and Technology Transfer Program of Shenyang Science and Technology Plan (Grant No.18-400-6-16).
Publisher Copyright:
© 2019 IEEE.
PY - 2019/11
Y1 - 2019/11
N2 - In recent years, reinforcement learning has been developed dramatically and is widely used to solve control problems, e.g., playing games. However, there are still some problems for reinforcement learning to perform robotic control tasks. Fortunately, the kernel trick-based methods provide a chance to deal with those challenges. This work aims at developing a kernel trick-based learning control method to carry out robotic tracking control tasks. A reward system, in this work, is presented in order to speed up the learning processes. And then, a kernel trick-based reinforcement learning tracking controller is presented to perform tracking control tasks on a robotic manipulator system. To evaluate the policy and assist the reward system to accelerate the speed of finding the optimal control policy, a critic system is introduced. Finally, from the comparison with the benchmark, the simulation results illustrate that our algorithm has faster convergence rate and can execute tracking control tasks effectively, the reward function and the critic system proposed in this work is efficient.
AB - In recent years, reinforcement learning has been developed dramatically and is widely used to solve control problems, e.g., playing games. However, there are still some problems for reinforcement learning to perform robotic control tasks. Fortunately, the kernel trick-based methods provide a chance to deal with those challenges. This work aims at developing a kernel trick-based learning control method to carry out robotic tracking control tasks. A reward system, in this work, is presented in order to speed up the learning processes. And then, a kernel trick-based reinforcement learning tracking controller is presented to perform tracking control tasks on a robotic manipulator system. To evaluate the policy and assist the reward system to accelerate the speed of finding the optimal control policy, a critic system is introduced. Finally, from the comparison with the benchmark, the simulation results illustrate that our algorithm has faster convergence rate and can execute tracking control tasks effectively, the reward function and the critic system proposed in this work is efficient.
UR - http://www.scopus.com/inward/record.url?scp=85081155082&partnerID=8YFLogxK
U2 - 10.1109/IROS40897.2019.8968574
DO - 10.1109/IROS40897.2019.8968574
M3 - Conference proceeding
AN - SCOPUS:85081155082
SN - 9781728140056
T3 - IEEE International Conference on Intelligent Robots and Systems
SP - 997
EP - 1002
BT - 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2019 - Proceedings
PB - IEEE
T2 - 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2019
Y2 - 3 November 2019 through 8 November 2019
ER -