Learning of Tool Affordances for autonomous tool manipulation

• Published in: 2011 IEEE/SICE International Symposium on System Integration pp. 814 - 819
• Main Authors: Jain, R., Inamura, T.
• Format: Conference Proceeding
• Language: English; Japanese
• Published: IEEE 01.12.2011
• Subjects: Bayesian methods; Learning systems; Manipulators; Robot sensing systems; Shape; Silicon
• ISBN: 9781457715235; 1457715236
• DOI: 10.1109/SII.2011.6147553

We present the concept of Tool Affordances to plan a strategy for target object manipulation by a tool via understanding of bi-directional association between Actions, Tools and Effects. Tool Affordances include the awareness within robot about the different kind of effects it can create in the environment using an action and a tool. Robot learns tool affordances by exploring the environment through its motor actions using different tools and learning their association with observed effects. The strength of our model is the robots ability of prediction and inference given some evidence. To deal with uncertainty, redundancy and irrelevant information Bayesian Network as the probabilistic model is chosen for implementation of our Tool Affordance model. We demonstrate a preliminary experiment where robot uses learnt Tool Affordances to correctly infer the most appropriate novel Action and Tool given the observed effects.