RESEARCH PAPER
A Multi-scale Attention Mechanism Diagnosis Method with Adaptive Online Updating Based on Deep Learning under Variable Working Conditions
More details
Hide details
1
College of Automation Engineering,, Nanjing University of Aeronautics and Astronautics, China
2
Institute of Intelligent Manufacturing, Nanjing Tech University, China
3
College of Electrical Engineering and Control Science, Nanjing Tech University, China
Submission date: 2024-06-14
Final revision date: 2024-07-31
Acceptance date: 2024-09-04
Online publication date: 2024-09-26
Publication date: 2024-09-26
Corresponding author
Ningyun Lu
College of Automation Engineering,, Nanjing University of Aeronautics and Astronautics, No. 169 Sheng Tai West Road, Jiang Ning District,, 211106, Nanjing, China
Eksploatacja i Niezawodność – Maintenance and Reliability 2025;27(1):192975
HIGHLIGHTS
- Multi-scale attention method with adaptive online updating for variable conditions.
- Flexibly updates diagnostic models based on online data status.
- Adaptive weight random undersampling balances inter-class data uniformly.
KEYWORDS
TOPICS
ABSTRACT
With the advance of industrial systems, the online equipment fault diagnosis has encountered many challenges such as data drift and data imbalance under varying operating conditions, thus making stable and accurate diagnosis increasingly critical. Considering the above issues, a multi-scale attention mechanism diagnosis method with adaptive model that can be updated based on deep learning has been proposed. The method is composed of four main steps: training the multi-scale offline diagnosis model, transferring the parameters of the offline model, assessing the degree of data drifting, and adaptively updating the diagnostic model. A data balance strategy with adaptive weight balances both inter-class and intra-class data. The method updates the diagnostic model flexibly according to online data status, to reduce the impact of data drifting. The method was verified on a bearing test rig, which can reproduce the common bearing faults under variable working conditions. The experimental results have shown that the proposed method can accurately and reliably identify the bearing faults.
ACKNOWLEDGEMENTS
This work was supported in part by the National Natural Science Foundation of China under Grant 62020106003, Grant 61873122, Grant 62203213, and Grant 62303217, in part by the Aero Engine Corporation of China Industry-university-research cooperation project under Grant HFZL2020CXY011, in part by the the Research Fund of State Key Laboratory of Mechanics and Control of Mechanical Structures under Grant MCMS-I-0121G03, in part by the National Key Research and Development Program of China under Grant 2021YFB3301300, in part by the Natural Science Foundation of Jiangsu Province under Grant BK20220332, in part by the China Scholarship Council under Grant 202206830124, and in part by the Natural Science Foundation of the Jiangsu Higher Education Institutions of China under Grant 23KJB510006.
REFERENCES (38)
1.
Malialis K, Panayiotou CG, M. M. Polycarpou. Online Learning With Adaptive Rebalancing in Nonstationary Environments. IEEE Transactions on Neural Networks and Learning Systems 2021; 32(10): 4445-4459,
https://doi.org/10.1109/TNNLS.....
2.
Niu G, Wang X, Golda M, Mastro S, Zhang B. An optimized adaptive PReLU-DBN for rolling element bearing fault diagnosis. Neurocomputing 2021; 445: 26-34,
https://doi.org/10.1016/j.neuc....
3.
Jiang B, Zhang K, Shi P. Integrated Fault Estimation and Accommodation Design for Discrete-Time Takagi–Sugeno Fuzzy Systems With Actuator Faults. IEEE Transactions on Fuzzy Systems 2011; 19(2): 291-304,
https://doi.org/10.1109/TFUZZ.....
4.
Lu N, Jiang B, Meng X, et al. Diagnosis, Diagnosticability Analysis, and Test Point Design for Multiple Faults Based on Multisignal Modeling and Blind Source Separation. IEEE Transactions on Systems, Man, and Cybernetics: Systems 2017; 1-12,
https://doi.org/10.1109/TSMC.2....
5.
Ciabattoni L, Ferracuti F, Freddi A, Monteriù A. Statistical Spectral Analysis for Fault Diagnosis of Rotating Machines. IEEE Transactions on Industrial Electronics 2018; 65(5): 4301-4310, doi: 10.1109/TIE.2017.2762623.
6.
Rai V K, Mohanty A R. Bearing fault diagnosis using FFT of intrinsic mode functions in Hilbert–Huang transform. Mechanical Systems and Signal Processing 2007; 21(6): 2607-2615, DOI: 10.1016/j.ymssp.2006.12.004.
7.
Chu F, Liao S, Hao L, Wang P, Liu Y, Wang F. Operating Performance Assessment Method for Industrial Process with Slowness Principle-Based LSTM Network. Engineering Applications of Artificial Intelligence 2023; 123(part: A). DOI: 10.1016/j.engappai.2023.106208.
8.
Chu F, Mo S, Hao L, Lu N, Wang F. Operating Performance Assessment of Complex Nonlinear Industrial Process Based on Kernel Locally Linear Embedding PLS. IEEE Transactions on Automation Science and Engineering 2024; 21(1):593-605. DOI: 10.1109/tase.2022.3230687.
9.
Chen C, Tao G, Shi J, Shen M, Zhu Z. A Lithium-ion battery degradation prediction model with uncertainty quantification for its predictive maintenance. IEEE Transactions on Industrial Electronics 2024; 71(4), 3650-3659. DOI: 10.1109/TIE.2023.3274874.
10.
Liu R, Yang B, Zio E, Chen X. Artificial intelligence for fault diagnosis of rotating machinery: A review. Mechanical Systems and Signal Processing 2018; 108: 33-47,
https://doi.org/10.1016/j.ymss....
11.
Zhao B, Zhang X, Hai L, et al. Intelligent fault diagnosis of rolling bearings based on normalized CNN considering data imbalance and variable working conditions. Knowledge-Based Systems 2020; 199: 105971, DOI: 10.1016/j.knosys.2020.105971.
12.
Zhang Y, Ding J, Li Y, Ren Z, Feng K. Multi-modal data cross-domain fusion network for gearbox fault diagnosis under variable operating conditions. Engineering Applications of Artificial Intelligence 2024; 133: 108236,
https://doi.org/10.1016/j.enga....
13.
Wan L, Ning J, Li Y, et al. Intelligent fault diagnosis via ring-based decentralized federated transfer learning. Knowledge-Based Systems 2024; 284: 111288,
https://doi.org/10.1016/j.knos... C, Zio E, Shen W. Domain generalization for cross-domain fault diagnosis: Anapplication-oriented perspective and a benchmark study. Reliability Engineering & System Safety 2024; 245: 109964,
https://doi.org/10.1016/j.ress....
14.
Zhang C, He Y, Jiang S, Wang T, Yuan L, Li B. Transformer Fault Diagnosis Method Based on Self-Powered RFID Sensor Tag, DBN, and MKSVM. IEEE Sensors Journal 2019; 19(18): 8202-8214, DOI: 10.1109/JSEN.2019.2919868.
15.
Yang B, Lei Y, Jia F, et al. An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings. Mechanical Systems and Signal Processing 2019; 122: 692-706, DOI: 10.1016/j.ymssp.2018.12.051.
16.
Li X, Jiang H, Xie M, Wang T, Wang R, Wu Z. A reinforcement ensemble deep transfer learning network for rolling bearing fault diagnosis with Multi-source domains. Advanced Engineering Informatics 2022; 51: 101480, ISSN 1474-0346,
https://doi.org/10.1016/j.aei.....
17.
Huo C, Jiang Q, Shen Y, Zhu Q, Zhang Q. Enhanced transfer learning method for rolling bearing fault diagnosis based on linear superposition network. Engineering Applications of Artificial Intelligence 2023; 121: 105970,
https://doi.org/10.1016/j.enga....
18.
Plakias S, Boutalis YS. Fault detection and identification of rolling element bearings with Attentive Dense CNN. Neurocomputing 2020; 405: 208-217,
https://doi.org/10.1016/j.neuc....
19.
Maged A, Lui CF, Haridy S, Xie M. Variational AutoEncoders-LSTM Based Fault Detection of Time-Dependent High Dimensional Processes. International Journal of Production Research 2024; 62(4): 1092-1107. doi:10.1080/00207543.2023.2175591.
20.
Weng Q, Ren S, Zhu B, Jin Y, Si F. Reconstruction-based stacked sparse auto-encoder for nonlinear industrial process fault diagnosis. Eksploatacja i Niezawodność-Maintenance and Reliability 2024; 26(1). DOI:10.17531/ein/175873.
21.
Peng W, Ye ZS, Chen N. Bayesian Deep-Learning-Based Health Prognostics Toward Prognostics Uncertainty. IEEE Transactions on Industrial Electronics 2020; 67(3): 2283-2293, March, DOI: 10.1109/TIE.2019.2907440.
22.
Li C, Sanchez RV, Zurita G, et al. Multimodal deep support vector classification with homologous features and its application to gearbox fault diagnosis. Neurocomputing 2015; 168: 119-127.
https://doi.org/10.1016/j.neuc....
23.
Song B, Liu Y, Fang J, et al. An optimized CNN-BiLSTM network for bearing fault diagnosis under multiple working conditions with limited training samples. Neurocomputing 2024; 574: 127284,
https://doi.org/10.1016/j.neuc....
24.
Wang X, Yao Y, Gao C. Wasserstein Distance- EEMD Enhanced Multi-Head Graph Attention Network for Rolling Bearing Fault Diagnosis Under Different Working Conditions. Eksploatacja i Niezawodność-Maintenance and Reliability 2024; 26(2). DOI:10.17531/ein/184037.
25.
Huang Z, Zhao X. A novel multi-scale competitive network for fault diagnosis in rotating machinery. Engineering Applications of Artificial Intelligence 2024; 128: 107441.
https://doi.org/10.1016/j.enga....
26.
Wang J, Ren H, Shen C, Huang W, Zhu Z. Multi-scale style generative and adversarial contrastive networks for single domain generalization fault diagnosis. Reliability Engineering & System Safety 2024; 243: 109879.
https://doi.org/10.1016/j.ress....
27.
Wang R, Chen Z, Zhang S, et al. Dual-attention generative adversarial networks for fault diagnosis under the class-imbalanced conditions. IEEE Sensors Journal 2021; 22(2): 1474-1485,
https://doi.org/10.1109/JSEN.2....
28.
Wang C, Lu N, Cheng Y, et al. A Data-Driven Aero-Engine Degradation Prognostic Strategy. IEEE Transactions on Cybernetics 2019; PP(99): 1-11. DOI: 10.1109/TCYB.2019.2938244.
29.
Jiang B, Shen Q, Shi P. Neural-networked adaptive tracking control for switched nonlinear pure-feedback systems under arbitrary switching. Automatica 2015; 61: 119-125,
https://doi.org/10.1016/j.auto....
30.
Wang H, Zheng J, Xiang J. Online bearing fault diagnosis using numerical simulation models and machine learning classifications. Reliability Engineering & System Safety 2023; 234: 109142,
https://doi.org/10.1016/j.ress....
31.
Xu Q, Zhu B, Huo H, et al. Fault diagnosis of rolling bearing based on online transfer convolutional neural network. Applied Acoustics 2022; 192: 108703,
https://doi.org/10.1016/j.apac....
32.
Mao W, Ding L, Liu Y, et al. A new deep domain adaptation method with joint adversarial training for online detection of bearing early fault. ISA Transactions 2022; 122: 444-458,
https://doi.org/10.1016/j.isat....
33.
Zhao Y, Zhang X, Wang J, et al. A new data fusion driven-sparse representation learning method for bearing intelligent diagnosis in small and unbalanced samples. Engineering Applications of Artificial Intelligence 2023; 117: 105513,
https://doi.org/10.1016/j.enga....
34.
Luo W, Yang W, He J, et al. Fault diagnosis method based on two-stage GAN for data imbalance. IEEE Sensors Journal 2022; 22(22): 21961-21973,
https://doi.org/10.1109/JSEN.2....
35.
Huang H, Baddour N. Bearing vibration data collected under time-varying rotational speed conditions. Data in brief 2018; 21: 1745-1749,
https://doi.org/10.1016/j.dib.....
36.
Zuber N, Bajrić R. Gearbox faults feature selection and severity classification using machine learning. Eksploatacja i Niezawodność -Maintenance and Reliability 2020;22(4):748-756. DOI:10.17531/ein.2020.4.19.
37.
Li J, Liu Z, Qiu M, Niu K. Fault diagnosis model of rolling bearing based on parameter adaptive VMD algorithm and Sparrow Search Algorithm-Based PNN. Eksploatacja i Niezawodność-Maintenance and Reliability 2023; 25(2). DOI:10.17531/ein/163547.
38.
Hou Y, Wu P, Wu D. An operating condition information-guided iterative variational mode decomposition method based on Mahalanobis distance criterion for surge characteristic frequency extraction of the centrifugal compressor. Mechanical Systems and Signal Processing 2023; 186: 109836,
https://doi.org/10.1016/j.ymss....