skip to main content
10.1145/3538712.3538743acmotherconferencesArticle/Chapter ViewAbstractPublication PagesssdbmConference Proceedingsconference-collections
short-paper

Crack Detection and Localization based on Spatio-Temporal Data using Residual Networks

Published: 23 August 2022 Publication History

Abstract

Damage detection in materials and structures plays a critical role in engineering and science applications like structural health monitoring. A particular challenge is presented by micro-scale cracks, which are imperceptible to the naked eye or in images, but may ultimately evolve into larger, potentially dangerous cracks. In this work, we propose spatio-temporal pattern recognition techniques to enable the detection of such imperceptible micro-cracks. In order to make these cracks detectable, we generate seismic waves on the surface area of interest and monitor how cracks interfere with the spatial propagation of the wave over time. On the resulting propagation image series we then apply segmentation techniques using deep encoder-decoder CNNs to predict the location of cracks, which otherwise could not be directly observed. Our solution is evaluated through extensive experiments on highly-realistic finite element simulations, which were developed by domain experts.

References

[1]
V. Badrinarayanan, A. Kendall, and R. Cipolla. 2017. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 12(2017), 2481–2495.
[2]
Seongdeok Bang, Somin Park, Hongjo Kim, and Hyoungkwan Kim. 2019. Encoder–decoder network for pixel-level road crack detection in black-box images. Computer-Aided Civil and Infrastructure Engineering 34, 8(2019), 713–727.
[3]
Liang-Chieh Chen, Yukun Zhu, George Papandreou, Florian Schroff, and Hartwig Adam. 2018. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. In Proceedings of the European conference on computer vision (ECCV). 801–818.
[4]
Jianghua Deng, Ye Lu, and Vincent Cheng-Siong Lee. 2021. Imaging-based crack detection on concrete surfaces using You Only Look Once network. Structural Health Monitoring 20, 2 (2021), 484–499.
[5]
Mohsen Fayyaz, Mohammad Hajizadeh Saffar, Mohammad Sabokrou, Mahmood Fathy, Reinhard Klette, and Fay Huang. 2016. STFCN: spatio-temporal FCN for semantic video segmentation. arXiv preprint arXiv:1608.05971(2016).
[6]
K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770–778.
[7]
Shruti Jadon. 2020. A survey of loss functions for semantic segmentation. In 2020 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB). IEEE, 1–7.
[8]
Alex Kendall, Vijay Badrinarayanan, and Roberto Cipolla. 2016. Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding. In British Machine Vision Conference 2017, BMVC 2017.
[9]
Bubryur Kim, N. Yuvaraj, K. R. Sri Preethaa, and R. Arun Pandian. 2021. Surface crack detection using deep learning with shallow CNN architecture for enhanced computation. Neural Computing and Applications 33, 15 (01 Aug 2021), 9289–9305.
[10]
Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. 3rd International Conference on Learning Representations (ICLR) (2015).
[11]
Donghan Lee, Jeongho Kim, and Daewoo Lee. 2019. Robust concrete crack detection using deep learning-based semantic segmentation. International Journal of Aeronautical and Space Sciences 20, 1(2019), 287–299.
[12]
Shengyuan Li and Xuefeng Zhao. 2018. Convolutional neural networks-based crack detection for real concrete surface. In Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2018, Vol. 10598. International Society for Optics and Photonics, SPIE, 955 – 961.
[13]
Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollár. 2017. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision. 2980–2988.
[14]
Eftychios Protopapadakis, Athanasios Voulodimos, Anastasios Doulamis, Nikolaos Doulamis, and Tania Stathaki. 2019. Automatic crack detection for tunnel inspection using deep learning and heuristic image post-processing. Applied Intelligence 49, 7 (2019), 2793–2806.
[15]
Zarghaam Haider Rizvi, Frank Wuttke, and Amir Shorian Sattari. 2018. Dynamic Analysis by Lattice Element Method Simulation. In Proceedings of China-Europe Conference on Geotechnical Engineering. Springer International Publishing, 405–409.
[16]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015(Lecture Notes in Computer Science). Springer International Publishing, 234–241.
[17]
M. Teichmann, M. Weber, M. Zöllner, R. Cipolla, and R. Urtasun. 2018. MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving. In 2018 IEEE Intelligent Vehicles Symposium (IV). 1013–1020.
[18]
Yuexin Zhang, Jie Huang, and Fenghuang Cai. 2020. On Bridge Surface Crack Detection Based on an Improved YOLO v3 Algorithm. IFAC-PapersOnLine 53, 2 (2020), 8205–8210.

Cited By

View all

Index Terms

  1. Crack Detection and Localization based on Spatio-Temporal Data using Residual Networks

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      SSDBM '22: Proceedings of the 34th International Conference on Scientific and Statistical Database Management
      July 2022
      201 pages
      ISBN:9781450396677
      DOI:10.1145/3538712
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 August 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Convolutional Neural Networks
      2. Crack Detection
      3. Structural Health Monitoring

      Qualifiers

      • Short-paper
      • Research
      • Refereed limited

      Funding Sources

      Conference

      SSDBM 2022

      Acceptance Rates

      Overall Acceptance Rate 56 of 146 submissions, 38%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)19
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 01 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media