Tabu Temporal Difference Learning for Robot Path Planning in Uncertain Environments

• Published in: Towards Autonomous Robotic Systems Vol. 10965; pp. 123 - 134
• Main Authors: Wei, Changyun, Ni, Fusheng
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2018; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Path planning; Reinforcement learning; Uncertain environments
• ISBN: 9783319967271; 3319967274
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-319-96728-8_11

This paper addresses the robot path planning problem in uncertain environments, where the robot has to avoid potential collisions with other agents or obstacles, as well as rectify actuation errors caused by environmental disturbances. This problem is motivated by many practical applications, such as ocean exploration by underwater vehicles, and package transportation in a warehouse by mobile robots. The novel feature of this paper is that we propose a Tabu methodology consisting of an Adaptive Action Selection Rule and a Tabu Action Elimination Strategy to improve the classic Temporal Difference (TD) learning approach. Furthermore, two classic TD learning algorithms (i.e., Q-learning and SASRA) are revised by the proposed Tabu methodology for optimizing learning performance. We use a simulated environment to evaluate the proposed algorithms. The results show that the proposed approach can provide an effective solution for generating collision-free and safety paths for robots in uncertain environments.