Mixed Reality User Interface for a Hybrid Operation Room

• Published in: IEEE International Symposium on Mixed and Augmented Reality Workshops (Online) pp. 833 - 838
• Main Authors: Hemm, Johannes, Wasenmuller, Oliver, Siegfarth, Marius, Schafer, Armin
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2022
• Subjects: 3D user interaction-mixed reality-augmented reality; collision avoidance-Hybrid OR-robot-assisted surgery; Head-mounted displays; Interaction design-User interface design; Medical devices; Mixed reality; Object recognition; Presses; robotic simulation-digital twin-digital operation room; Three-dimensional displays; User interfaces
• ISSN: 2771-1110
• DOI: 10.1109/ISMAR-Adjunct57072.2022.00180

Simultaneous use of multiple complex devices for imaging and intervention purposes in a Hybrid operation room creates new challenges to the medical staff, such as avoiding collisions of different systems. Augmented reality presents a potential solution to this challenge. By visually overlaying real devices with their digital twin, users can see anticipated movements of the medical devices in a head-mounted display. With this information they can identify potential collisions before moving the device. This paper focuses on the design of a novel mixed reality user interface for a Hybrid operating room, which enables users to control multiple devices virtually. Two versions of the mixed reality user interface with different user input approaches are compared in a within-subject study regarding their usability and their suitability in steering medical devices virtually. Users were significantly faster completing study tasks with the input module press and hold button than with a virtual joystick. Additionally user experience was rated higher for the press and hold button.