Road Damage Detection and Classification Using Deep Neural Networks with Smartphone Images

• Published in: Computer-aided civil and infrastructure engineering Vol. 33; no. 12; pp. 1127 - 1141
• Main Authors: Maeda, Hiroya, Sekimoto, Yoshihide, Seto, Toshikazu, Kashiyama, Takehiro, Omata, Hiroshi
• Format: Journal Article
• Language: English
• Published: Hoboken Wiley Subscription Services, Inc 01.12.2018
• Subjects: Artificial neural networks; Damage detection; Datasets; Image classification; Image detection; Image processing; Neural networks; Object recognition; Smartphones; Traffic accidents & safety
• ISSN: 1093-9687; 1467-8667
• DOI: 10.1111/mice.12387

Research on damage detection of road surfaces using image processing techniques has been actively conducted. This study makes three contributions to address road damage detection issues. First, to the best of our knowledge, for the first time, a large‐scale road damage data set is prepared, comprising 9,053 road damage images captured using a smartphone installed on a car, with 15,435 instances of road surface damage included in these road images. Next, we used state‐of‐the‐art object detection methods using convolutional neural networks to train the damage detection model with our data set, and compared the accuracy and runtime speed on both, using a GPU server and a smartphone. Finally, we demonstrate that the type of damage can be classified into eight types with high accuracy by applying the proposed object detection method. The road damage data set, our experimental results, and the developed smartphone application used in this study are publicly available (https://github.com/sekilab/RoadDamageDetector/).