skip to main content
10.1145/3460426.3463666acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
short-paper

A Beneficial Dual Transformation Approach for Deep Learning Networks Used in Steel Surface Defect Detection

Published: 01 September 2021 Publication History

Abstract

Steel surface defect detection represents a challenging task in real-world practical object detection. Based on our observations, there are two critical problems which create this challenge: the tiny size, and vagueness of the defects. To solve these problems, this study a proposes a deep learning-based defect detection system that uses automatic dual transformation in the end-to-end network. First, the original training images in RGB are transformed into the HSV color model to re-arrange the difference in color distribution. Second, the feature maps are upsampled using bilinear interpolation to maintain the smaller resolution. The latest and state-of-the-art object detection model, High-Resolution Network (HRNet) is utilized in this system, with initial transformation performed via data augmentation. Afterward, the output of the backbone stage is applied to the second transformation. According to the experimental results, the proposed approach increases the accuracy of the detection of class 1 Severstal steel surface defects by 3.6% versus the baseline.

References

[1]
Fityanul Akhyar, Chih-Yang Lin, Kahlil Muchtar, Tung-Ying Wu, and Hui-Fuang Ng, 2019. High Efficient Single-stage Steel Surface Defect Detection. In 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) IEEE, 1--4.
[2]
Zhaowei Cai and Nuno Vasconcelos, 2018. Cascade r-cnn: Delving into high quality object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, 6154--6162.
[3]
Yu He, Kechen Song, Qinggang Meng, and Yunhui Yan, 2019. An end-to-end steel surface defect detection approach via fusing multiple hierarchical features. IEEE Transactions on Instrumentation and Measurement 69, 4, 1493--1504.
[4]
Chih-Yang Lin, Cheng-Hsun Chen, Ching-Yuan Yang, Fityanul Akhyar, Chao-Yung Hsu, and Hui-Fuang Ng, 2019. Cascading convolutional neural network for steel surface defect detection. In International Conference on Applied Human Factors and Ergonomics Springer, 202--212.
[5]
Ka Max, 2005. Computer graphics and Geometric Modelling: Implementation and Modelling Springer-Verlag London Limited.
[6]
Jiangmiao Pang, Cong Li, Jianping Shi, Zhihai Xu, and Huajun Feng, 2019. R2-CNN: Fast Tiny Object Detection in Large-scale Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing 57, 8, 5512--5524.
[7]
Chunhe Song, Wenxiang Xu, Zhongfeng Wang, Shimao Yu, Peng Zeng, and Zhaojie Ju, 2020. Analysis on the Impact of Data Augmentation on Target Recognition for UAV-Based Transmission Line Inspection. Complexity 2020.
[8]
David Tellez, Geert Litjens, Péter Bándi, Wouter Bulten, John-Melle Bokhorst, Francesco Ciompi, and Jeroen Van Der Laak, 2019. Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology. Medical image analysis 58, 101544.
[9]
Sergios Theodoridis and Rama Chellappa, 2014. Academic Press Library in Signal Processing: Image and Video Compression and Multimedia. Academic Press.
[10]
Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, and Xinggang Wang, 2020. Deep high-resolution representation learning for visual recognition. IEEE transactions on pattern analysis and machine intelligence.
[11]
Ning Wang, Yang Gao, Hao Chen, Peng Wang, Zhi Tian, Chunhua Shen, and Yanning Zhang, 2020. NAS-FCOS: Fast neural architecture search for object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 11943--11951.

Cited By

View all

Index Terms

  1. A Beneficial Dual Transformation Approach for Deep Learning Networks Used in Steel Surface Defect Detection

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMR '21: Proceedings of the 2021 International Conference on Multimedia Retrieval
    August 2021
    715 pages
    ISBN:9781450384636
    DOI:10.1145/3460426
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 September 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. RGB to HSV
    2. bilinear interpolation
    3. defect detection system
    4. high-resolution network

    Qualifiers

    • Short-paper

    Funding Sources

    Conference

    ICMR '21
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 254 of 830 submissions, 31%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)16
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 28 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media