Random bridge generator as a platform for developing computer vision-based structural inspection algorithms

• Published in: Journal of Infrastructure Intelligence and Resilience Vol. 3; no. 2; p. 100098
• Main Authors: Cheng, Haojia, Chai, Wenhao, Hu, Jiabao, Ruan, Wenhao, Shi, Mingyu, Kim, Hyunjun, Cao, Yifan, Narazaki, Yasutaka
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.06.2024
• Subjects: Bridge inspection; Computer graphics; Deep learning; Synthetic environment; Visual recognition; Deep learning; Synthetic environment; Bridge inspection; Computer graphics; Visual recognition
• ISSN: 2772-9915; 2772-9915
• DOI: 10.1016/j.iintel.2024.100098

Recent advances in computer vision algorithms have transformed the bridge visual inspection process. Those algorithms typically require large amounts of annotated data, which is lacking for generic bridge inspection scenarios. To address this challenge efficiently, this research designs, develops, and demonstrates a platform that can provide synthetic datasets and testing environments, termed Random Bridge Generator (RBG). The RBG produces photo-realistic 3D synthetic environments of six types of bridges randomly, automatically, and procedurally. Following relevant standards and design practice, the RBG creates random cross-sectional shapes, converts those shapes into bridge components, and assembles the components into bridges. The effectiveness of the RBG is demonstrated by producing a dataset (RBG Dataset) containing 10,753 images with pixel-wise annotations, rendered in 250 different synthetic environments. Significant diversity of the photo-realistic bridge inspection environments has been achieved, while all structural components strictly conform to the definitions derived from structural engineering documents. The use of the RBG dataset has been demonstrated by training a deep semantic segmentation algorithm with 101 convolutional layers, showing successful segmentation results for both major and minor structural components. The developed RBG is expected to enhance the level of automation in bridge visual inspection process. The Python code for RBG is made public at: https://github.com/chenghaojia2323/Random-Bridge-Generator.git. •A platform that can provide synthetic datasets and testing environments, termed Random Bridge Generator, is developed.•The RBG can produce photo-realistic 3D synthetic environments of six types of bridges randomly, automatically, and procedurally.•Using RBG, a dataset containing 10,753 images and the corresponding annotations is produced (RBG Dataset).•The RBG Dataset is successfully applied to train a deep semantic segmentation algorithm.•The developed RBG can enhance the level of automation in bridge visual inspection.