A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks

• Published in: Advanced robotics Vol. 22; no. 13-14; pp. 1521 - 1537
• Main Authors: Mayer, Hermann, Gomez, Faustino, Wierstra, Daan, Nagy, Istvan, Knoll, Alois, Schmidhuber, Jürgen
• Format: Journal Article
• Language: English
• Published: Taylor & Francis Group 01.01.2008
• Subjects: ARTIFICIAL EVOLUTION; AUTOMATED KNOT TYING; MINIMALLY INVASIVE SURGERY; RECURRENT NEURAL NETWORKS; SUPERVISED LEARNING
• ISSN: 0169-1864; 1568-5535; 1568-5535
• DOI: 10.1163/156855308X360604

Tying suture knots is a time-consuming task performed frequently during minimally invasive surgery (MIS). Automating this task could greatly reduce total surgery time for patients. Current solutions to this problem replay manually programmed trajectories, but a more general and robust approach is to use supervised machine learning to smooth surgeon-given training trajectories and generalize from them. Since knot tying generally requires a controller with internal memory to distinguish between identical inputs that require different actions at different points along a trajectory, it would be impossible to teach the system using traditional feedforward neural nets or support vector machines. Instead we exploit more powerful, recurrent neural networks (RNNs) with adaptive internal states. Results obtained using long short-term memory RNNs trained by the recent Evolino algorithm show that this approach can significantly increase the efficiency of suture knot tying in MIS over preprogrammed control.