Combining a Brain–Machine Interface and an Electrooculography Interface to perform pick and place tasks with a robotic arm

• Published in: Robotics and autonomous systems Vol. 72; pp. 181 - 188
• Main Authors: Hortal, Enrique, Iáñez, Eduardo, Úbeda, Andrés, Perez-Vidal, Carlos, Azorín, José M.
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.10.2015
• Subjects: Brain–Machine Interface; EEG signals; Electrooculography interface; Multimodal interface; EEG signals; Multimodal interface; Electrooculography interface; Brain–Machine Interface
• ISSN: 0921-8890; 1872-793X
• DOI: 10.1016/j.robot.2015.05.010

This paper presents a multimodal Human–Machine Interface system that combines an Electrooculography Interface and a Brain–Machine Interface. This multimodal interface has been used to control a robotic arm to perform pick and place tasks in a three dimensional environment. Five volunteers were asked to pick two boxes and place them in different positions. The results prove the feasibility of the system in the performance of pick and place tasks. By using the multimodal interface, all the volunteers (even naive users) were able to successfully move two objects within a satisfactory period of time with the help of the robotic arm. •A multimodal HMI to perform pick and place tasks with a robotic arm is presented.•The EOG interface is applied to control planar movements and to operate the gripper.•The BMI is used to control the height of the gripper through two mental tasks.•The system had been tested by five healthy subjects.•The results prove the feasibility of the system in the performance of these tasks.