In-place 3D sketching for authoring and augmenting mechanical systems

• Published in: 2009 8th IEEE International Symposium on Mixed and Augmented Reality pp. 87 - 94
• Main Authors: Bergig, Oriel, Hagbi, Nate, El-Sana, Jihad, Billinghurst, Mark
• Format: Conference Proceeding
• Language: English
• Published: Washington, DC, USA IEEE Computer Society 19.10.2009; IEEE
• Series: ACM Other Conferences
• Subjects: 3D content authoring; Assembly; Augmented Reality; Breast; Computing methodologies; Computing methodologies > Artificial intelligence; Computing methodologies > Artificial intelligence > Computer vision; Computing methodologies > Artificial intelligence > Computer vision > Image and video acquisition; Computing methodologies > Artificial intelligence > Computer vision > Image and video acquisition > 3D imaging; Computing methodologies > Computer graphics; Computing methodologies > Computer graphics > Graphics systems and interfaces; Computing methodologies > Computer graphics > Graphics systems and interfaces > Virtual reality; dual perception; Education; Educational institutions; free hand sketching; Human-centered computing; Human-centered computing > Human computer interaction (HCI); Human-centered computing > Human computer interaction (HCI) > Interaction paradigms; Human-centered computing > Human computer interaction (HCI) > Interaction paradigms > Mixed > augmented reality; Human-centered computing > Human computer interaction (HCI) > Interaction paradigms > Virtual reality; In-Place Augmented Reality; interaction by sketching; Mechanical systems; Object detection; Output feedback; physical simulation; Psychology; Virtual reality; visual language; Visualization
• ISBN: 9781424453900; 1424453909
• DOI: 10.1109/ISMAR.2009.5336490

We present a framework for authoring three-dimensional virtual scenes for Augmented Reality (AR) which is based on hand sketching. Sketches consisting of multiple components are used to construct a 3D virtual scene augmented on top of the real drawing. Model structure and properties can be modified by editing the sketch itself and printed content can be combined with hand sketches to form a single scene. Authoring by sketching opens up new forms of interaction that have not been previously explored in Augmented Reality. To demonstrate the technology, we implemented an application that constructs 3D AR scenes of mechanical systems from freehand sketches, and animates the scenes using a physics engine. We provide examples of scenes composed from trihedral solid models, forces, and springs. Finally, we describe how sketch interaction can be used to author complicated physics experiments in a natural way.