skip to main content
research-article

A structurally re-parameterized convolution neural network-based method for gearbox fault diagnosis in edge computing scenarios

Published: 01 February 2024 Publication History

Abstract

Gearboxes operate in harsh environments. Cloud-based techniques have been previously adopted for fault diagnosis in Gearboxes. Cloud-based fault diagnosis methods are prone to time delays and loss of information. Therefore, edge computing-based fault diagnosis becomes an option. However, with limited hardware resources for edge devices, balancing the diagnostic capabilities of the model with operating performance becomes a challenge. This paper proposes a lightweight convolutional neural network for gearbox fault diagnosis in edge computing scenarios to achieve an accurate diagnosis and lightweight deployment of models. By constructing the Mel-Frequency Cepstral Coefficients (MFCC) feature matrix of input data, the methodology can suppress noise interference and improve diagnostic accuracy. Based on the structural re-parameterization, the model structure transforms from multiple branches at training time to a single branch at inference time. This improves the inference speed of the model and reduces the hardware cost when the model is deployed while ensuring that the diagnostic capability of the model remains unchanged. Validation experiments were conducted on a public dataset and a custom experimental device, using the NVIDIA Jetson Xavier NX kit as the edge computing platform. According to the experiment result, after extracting the MFCC feature matrix, the average diagnostic accuracy rate in the noisy environment of the presented methodology is improved by 12.22% and 9.44%, respectively. After structural re-parameterization, the Memory of the model decreases by 52.58%, and the inference speed is increased by 38.83%.

Highlights

A method for gearbox fault diagnosis in edge computing scenarios is proposed.
The inference speed and hardware overhead of the model can be highly improved through structural re-parameterization.
MFCC feature matrix is used to enhance the feature extraction capability of the network.
Two case studies show the effectiveness and efficiency of the proposed approach.

References

[1]
S. Belongie, M. Wilber, A. Veit, Residual networks behave like ensembles of relatively shallow networks, in: 30th Conference on Neural Information Processing Systems (NIPS)Barcelona, SPAIN, 2016.
[2]
J.L. Chen, Z.P. Li, J. Pan, G.G. Chen, Y.Y. Zi, J. Yuan, B.Q. Chen, Z.J. He, Wavelet Transform Based on Inner Product in Fault Diagnosis of Rotating Machinery: A Review, Mechanical Systems, and Signal Processing, 2016, pp. 1–35,. 70-71.
[3]
S. Chetlur, C. Woolley, P. Vandermersch, J. Cohen, J. Tran, B. Catanzaro, E. Shelhamer, Cudnn: Efficient Primitives for Deep Learning, 2014, arXiv preprint arXiv:1410.0759.
[4]
M. Chiang, T. Zhang, Fog and IoT: an overview of research opportunities, IEEE Internet Things J. 3 (2016) 854–864,.
[5]
F. Chollet, Xception: deep learning with depthwise separable convolutions, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1251–1258.
[6]
C. Dai, X. Liu, Z. Li, M.-Y. Chen, A tucker decomposition based knowledge distillation for intelligent edge applications, Appl. Soft Comput. 101 (2021),.
[7]
X.H. Ding, Y.C. Guo, G.G. Ding, J.G. Han, Ieee, ACNet: strengthening the kernel skeletons for powerful CNN via asymmetric convolution blocks, in: IEEE/CVF International Conference on Computer Vision (ICCV)Seoul, SOUTH KOREA, 2019, pp. 1911–1920.
[8]
X.H. Ding, X.Y. Zhang, J.G. Han, G.G. Ding, S.O.C. Ieee comp, diverse branch block: building a convolution as an inception-like unit, in: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)Electr Network, 2021, pp. 10881–10890.
[9]
X.H. Ding, X.Y. Zhang, N.N. Ma, J.G. Han, G.G. Ding, J. Sun, S.O.C. Ieee comp, RepVGG: making VGG-style ConvNets great again, in: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)Electr Network, 2021, pp. 13728–13737.
[10]
I. Errandonea, P. Ciáurriz, U. Alvarado, S. Beltrán, S. Arrizabalaga, Edge intelligence-based proposal for onboard catenary stagger amplitude diagnosis, Comput. Ind. 144 (2023),.
[11]
C. Gao, A. Rios-Navarro, X. Chen, S.C. Liu, T. Delbruck, EdgeDRNN: recurrent neural network accelerator for edge inference, Ieee Journal on Emerging and Selected Topics in Circuits and Systems 10 (2020) 419–432,.
[12]
S.S. Gill, M.X. Xu, C. Ottaviani, P. Patros, R. Bahsoon, A. Shaghaghi, M. Golec, V. Stankovski, H.M. Wu, A. Abraham, M. Singh, H. Mehta, S.K. Ghosh, T. Baker, A.K. Parlikad, H. Lutfiyya, S.S. Kanhere, R. Sakellariou, S. Dustdar, O. Rana, I. Brandic, S. Uhlig, AI for next generation computing: emerging trends and future directions, Internet of Things 19 (2022),.
[13]
K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770–778.
[14]
T. Hewa, A. Braeken, M. Liyanage, M. Ylianttila, Fog computing and blockchain-based security service architecture for 5G industrial IoT-enabled cloud manufacturing, IEEE Trans. Ind. Inf. 18 (2022) 7174–7185,.
[15]
Y. Huang, X. Qiao, J. Tang, P. Ren, L. Liu, C. Pu, J. Chen, An integrated cloud-edge-device adaptive deep learning service for cross-platform web, IEEE Trans. Mobile Comput. 22 (2023) 1950–1967,.
[16]
Z.Q. Huo, M. Martinez-Garcia, Y. Zhang, L. Shu, A multisensor information fusion method for high-reliability fault diagnosis of rotating machinery, IEEE Trans. Instrum. Meas. 71 (2022),.
[17]
T.T. Huong, T.P. Bac, D.M. Long, T.D. Luong, N.M. Dan, L.A. Quang, L.T. Cong, B.D. Thang, K.P. Tran, Detecting cyberattacks using anomaly detection in industrial control systems: a Federated Learning approach, Comput. Ind. 132 (2021),.
[18]
T. Jing, X. Tian, H. Hu, L. Ma, Deep learning-based cloud–edge collaboration framework for remaining useful life prediction of machinery, IEEE Trans. Ind. Inf. 18 (2022) 7208–7218,.
[19]
R.A. Khalil, N. Saeed, M. Masood, Y.M. Fard, M.S. Alouini, T.Y. Al-Naffouri, Deep learning in the industrial internet of things: potentials, challenges, and emerging applications, IEEE Internet Things J. 8 (2021) 11016–11040,.
[20]
X.J. Kong, Y.H. Wu, H. Wang, F. Xia, Edge computing for internet of everything: a survey, IEEE Internet Things J. 9 (2022) 23472–23485,.
[21]
A. Kumar, C.P. Gandhi, Y. Zhou, G. Vashishtha, R. Kumar, J. Xiang, Improved CNN for the diagnosis of engine defects of 2-wheeler vehicle using wavelet synchro-squeezed transform (WSST), Knowl. Base Syst. 208 (2020),.
[22]
A. Kumar, C. Parkash, G. Vashishtha, H. Tang, P. Kundu, J. Xiang, State-space modeling and novel entropy-based health indicator for dynamic degradation monitoring of rolling element bearing, Reliab. Eng. Syst. Saf. 221 (2022),.
[23]
A. Kumar, G. Vashishtha, C.P. Gandhi, H. Tang, J. Xiang, Tacho-less sparse CNN to detect defects in rotor-bearing systems at varying speed, Eng. Appl. Artif. Intell. 104 (2021),.
[24]
A. Lavin, S. Gray, Fast algorithms for convolutional neural networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 4013–4021.
[25]
Y.G. Lei, J. Lin, M.J. Zuo, Z.J. He, Condition monitoring and fault diagnosis of planetary gearboxes: a review, Measurement 48 (2014) 292–305,.
[26]
G.Q. Li, J. Wu, C. Deng, Z.Y. Chen, Parallel multi-fusion convolutional neural networks based fault diagnosis of rotating machinery under noisy environments, ISA Trans. 128 (2022) 545–555,.
[27]
H.F. Li, G.Z. Hu, J.Q. Li, M.C. Zhou, Intelligent Fault diagnosis for large-scale rotating machines using binarized deep neural networks and random forests, IEEE Trans. Autom. Sci. Eng. 19 (2022) 1109–1119,.
[28]
P. Liang, W. Wang, X. Yuan, S. Liu, L. Zhang, Y. Cheng, Intelligent fault diagnosis of rolling bearing based on wavelet transform and improved ResNet under noisy labels and environment, Eng. Appl. Artif. Intell. 115 (2022),.
[29]
G.L. McDonald, Q. Zhao, M.J. Zuo, Maximum correlated Kurtosis deconvolution and application on gear tooth chip fault detection, Mech. Syst. Signal Process. 33 (2012) 237–255,.
[30]
G. Qian, S. Lu, D. Pan, H. Tang, Y. Liu, Q. Wang, Edge computing: a promising framework for real-time fault diagnosis and dynamic control of rotating machines using multi-sensor data, IEEE Sensor. J. 19 (2019) 4211–4220,.
[31]
W. Qizhao, Q. Li, K. Wang, H. Wang, Z. Peng, Efficient federated learning for fault diagnosis in industrial cloud-edge computing, Computing, Archives for Informatics and Numerical Computation 103 (2021) 2319–2337.
[32]
L. Ren, Z. Jia, T. Wang, Y. Ma, L. Wang, LM-CNN: a cloud-edge collaborative method for adaptive fault diagnosis with label sampling space enlarging, IEEE Trans. Ind. Inf. 18 (2022) 9057–9067,.
[33]
F. Samie, L. Bauer, J. Henkel, From cloud down to things: an overview of machine learning in internet of things, IEEE Internet Things J. 6 (2019) 4921–4934,.
[34]
H. Shao, M. Xia, G. Han, Y. Zhang, J. Wan, Intelligent Fault diagnosis of rotor-bearing system under varying working conditions with modified transfer convolutional neural network and thermal images, IEEE Trans. Ind. Inf. 17 (2021) 3488–3496,.
[35]
S.Y. Shao, S. McAleer, R.Q. Yan, P. Baldi, Highly accurate machine fault diagnosis using deep transfer learning, IEEE Trans. Ind. Inf. 15 (2019) 2446–2455,.
[36]
W.S. Shi, J. Cao, Q. Zhang, Y.H.Z. Li, L.Y. Xu, Edge computing: vision and challenges, IEEE Internet Things J. 3 (2016) 637–646,.
[37]
X. Tang, Y. Xu, X. Sun, Y. Liu, Y. Jia, F. Gu, A.D. Ball, Intelligent fault diagnosis of helical gearboxes with compressive sensing based non-contact measurements, ISA Trans. (2022),.
[38]
H. Wang, J.W. Xu, C. Sun, R.Q. Yan, X.F. Chen, Intelligent Fault diagnosis for planetary gearbox using time-frequency representation and deep reinforcement learning, Ieee-Asme Transactions on Mechatronics 27 (2022) 985–998,.
[39]
Y.R. Wang, Q. Jin, G.D. Sun, C.F. Sun, Planetary gearbox fault feature learning using conditional variational neural networks under noise environment, Knowl. Base Syst. 163 (2019) 438–449,.
[40]
P.L. Wu, X.Y. Nie, G. Xie, Multi-sensor signal fusion for a compound fault diagnosis method with strong generalization and noise-tolerant performance, Meas. Sci. Technol. 32 (2021),.
[41]
H. Yan, H. Bai, X. Zhan, Z. Wu, L. Wen, X. Jia, Combination of vmd mapping MFCC and lstm: a new acoustic fault diagnosis method of diesel engine, Sensors 22 (2022),.
[42]
D. Yao, H. Liu, J. Yang, X. Li, A lightweight neural network with strong robustness for bearing fault diagnosis, Measurement 159 (2020),.
[43]
F. Yu, L. Cui, P. Wang, C. Han, R. Huang, X. Huang, EasiEdge: a novel global deep neural networks pruning method for efficient edge computing, IEEE Internet Things J. 8 (2021) 1259–1271,.
[44]
X.L. Yu, Y. Yang, Q.B. He, M.G. Du, Z.K. Peng, Multiple frequency modulation components detection and decomposition for rotary machine fault diagnosis, IEEE Trans. Instrum. Meas. 71 (2022),.
[45]
Y.L. Zeng, C.Y. Song, T.J. Ge, Y. Zhang, Reduction of large-scale graphs: effective edge shedding at a controllable ratio under resource constraints, Knowl. Base Syst. 240 (2022),.
[46]
K.L. Zhang, W. Huang, X.Y. Hou, J.H. Xu, R.D. Su, H.Y. Xu, a fault diagnosis and visualization method for high-speed train based on edge and cloud collaboration, Applied Sciences-Basel 11 (2021),.
[47]
L. Zhang, Q. Fan, J. Lin, Z. Zhang, X. Yan, C. Li, A nearly end-to-end deep learning approach to fault diagnosis of wind turbine gearboxes under nonstationary conditions, Eng. Appl. Artif. Intell. 119 (2023),.
[48]
Z.Z. Zhang, S.M. Li, J.R. Wang, Y. Xin, Z.H. An, X.X. Jiang, Enhanced sparse filtering with strong noise adaptability and its application on rotating machinery fault diagnosis, Neurocomputing 398 (2020) 31–44,.
[49]
M. Zhao, S. Zhong, X. Fu, B. Tang, M. Pecht, Deep residual shrinkage networks for fault diagnosis, IEEE Trans. Ind. Inf. 16 (2019) 4681–4690.
[50]
Y. Zhao, Y. Yin, G. Gui, Lightweight deep learning based intelligent edge surveillance techniques, Ieee Transactions on Cognitive Communications and Networking 6 (2020) 1146–1154,.

Cited By

View all

Index Terms

  1. A structurally re-parameterized convolution neural network-based method for gearbox fault diagnosis in edge computing scenarios
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image Engineering Applications of Artificial Intelligence
        Engineering Applications of Artificial Intelligence  Volume 126, Issue PC
        Nov 2023
        1571 pages

        Publisher

        Pergamon Press, Inc.

        United States

        Publication History

        Published: 01 February 2024

        Author Tags

        1. Lightweight neural network
        2. Edge computing
        3. Fault diagnosis
        4. Structural re-parameterization
        5. Noisy environments
        6. Deep learning

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 06 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all

        View Options

        View options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media