Online learning of a full body push recovery controller for omnidirectional walking

• Published in: 2011 11th IEEE-RAS International Conference on Humanoid Robots pp. 1 - 6
• Main Authors: Seung-Joon Yi, Byoung-Tak Zhang, Hong, Dennis, Lee, Daniel D.
• Format: Conference Proceeding
• Language: English; Japanese
• Published: IEEE 01.10.2011
• Subjects: Bipedal Omnidirectional Walking; Foot; Full Body Push Recovery; Humanoid robots; Legged locomotion; Online Learning; Reinforcement Learning; Robot sensing systems; Torso; Trajectory
• ISBN: 9781612848662; 1612848664
• ISSN: 2164-0572
• DOI: 10.1109/Humanoids.2011.6100896

Bipedal humanoid robots are inherently unstable to external perturbations, especially when they are walking on uneven terrain in the presence of unforeseen collisions. In this paper, we present a push recovery controller for position-controlled humanoid robots which is tightly integrated with an omnidirectional walk controller. The high level push recovery controller learns to integrate three biomechanically motivated push recovery strategies with a zero moment point based omnidirectional walk controller. Reinforcement learning is used to map the robot walking state, consisting of foot configuration and onboard sensory information, to the best combination of the three biomechanical responses needed to reject external perturbations. Experimental results show how this online method can stabilize an inexpensive, commercially- available DARwin-OP small humanoid robot.