iSarProjection: A KinectFusion Based Handheld Dynamic Spatial Augmented Reality System

• Published in: 2013 International Conference on Computer-Aided Design and Computer Graphics pp. 425 - 426
• Main Authors: Mengwen Tan, Weipeng Xu, Dongdong Weng
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.11.2013
• Subjects: Augmented reality; Biomedical imaging; Cameras; Dynamic Projection; Head; KinectFusion; Medical AR; Real-time systems; Spatial Augmented Reality; Surface reconstruction; Three-dimensional displays
• DOI: 10.1109/CADGraphics.2013.79

We introduce a general technique of dynamically augmenting physical models. Using a handheld projector attached with an RGBD camera, we map the physical model with corresponding textures, and develop a real-time dynamic spatial augmented reality (SAR) system named iSarProjection. Compared to traditional huge and complex tracking system, this technique, based on KinectFusion, supports precise registration between the physical model point cloud and the reconstructed 3D scene, and provides real-time pose estimation to track the physical display surface effectively. Through projecting medical anatomy visualizations on a white body model, it presents that we ease the development of dynamic SAR system and make it possible to be applied in various research fields.