Streaming mobile augmented reality on mobile phones

• Published in: 2009 8th IEEE International Symposium on Mixed and Augmented Reality pp. 181 - 182
• Main Authors: Chen, David M., Tsai, Sam S., Vedantham, Ramakrishna, Grzeszczuk, Radek, Girod, Bernd
• Format: Conference Proceeding
• Language: English
• Published: Washington, DC, USA IEEE Computer Society 19.10.2009; IEEE
• Series: ACM Other Conferences
• Subjects: Augmented reality; Cameras; Computing methodologies; Computing methodologies > Computer graphics; Computing methodologies > Computer graphics > Graphics systems and interfaces; Computing methodologies > Computer graphics > Graphics systems and interfaces > Virtual reality; Delay; Human-centered computing; Human-centered computing > Human computer interaction (HCI); Human-centered computing > Human computer interaction (HCI) > Interaction paradigms; Human-centered computing > Human computer interaction (HCI) > Interaction paradigms > Mixed > augmented reality; Human-centered computing > Human computer interaction (HCI) > Interaction paradigms > Virtual reality; Image databases; Layout; Mobile handsets; Motion estimation; Real time systems; Streaming media
• ISBN: 9781424453900; 1424453909
• DOI: 10.1109/ISMAR.2009.5336472

Continuous recognition and tracking of objects in live video captured on a mobile device enables real-time user interaction. We demonstrate a streaming mobile augmented reality system with 1 second latency. User interest is automatically inferred from camera movements, so the user never has to press a button. Our system is used to identify and track book and CD covers in real time on a phone's viewfinder. Efficient motion estimation is performed at 30 frames per second on a phone, while fast search through a database of 20,000 images is performed on a server.