Procedural 3D Building Reconstruction Using Shape Grammars and Detectors

• Published in: 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission pp. 304 - 311
• Main Authors: Mathias, M., Martinovic, A., Weissenberg, J., Van Gool, Luc
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2011
• Subjects: Buildings; Detectors; Grammar; Image reconstruction; Semantics; Shape; Three dimensional displays
• ISBN: 1612844294; 9781612844299
• ISSN: 1550-6185
• DOI: 10.1109/3DIMPVT.2011.45

We propose a novel grammar-driven approach for reconstruction of buildings and landmarks. Our approach complements Structure-from-Motion and image-based analysis with a 'inverse' procedural modeling strategy. So far, procedural modeling has mostly been used for creation of virtual buildings, while the inverse approaches typically focus on reconstruction of single facades. In our work, we reconstruct complete buildings as procedural models using template shape grammars. In the reconstruction process, we let the grammar interpreter automatically decide on which step to take next. The process can be seen as instantiating the template by determining the correct grammar parameters. As an example, we have chosen the reconstruction of Greek Doric temples. This process significantly differs from single facade segmentation due to the immediate need for 3D reconstruction.