TY - JOUR
T1 - An expert knowledge-empowered CNN approach for welding radiographic image recognition
AU - Liu, Tianyuan
AU - Zheng, Hangbin
AU - Zheng, Pai
AU - Bao, Jinsong
AU - Wang, Junliang
AU - Liu, Xiaojia
AU - Yang, Changqi
N1 - Funding Information:
This research is partially funded by the Mainland-Hong Kong Joint Funding Scheme (MHX/001/20), Innovation and Technology Commission (ITC), Hong Kong Special Administration Region, and National Key R&D Programs of Cooperation on Science and Technology Innovation with Hong Kong, Macao and Taiwan (SQ2020YFE020182), Ministry of Science and Technology (MOST) of the People's Republic of China.
Publisher Copyright:
© 2023
PY - 2023/4
Y1 - 2023/4
N2 - Non-destructive testing of welds based on the radiographic image is crucial for improving the reliability of aerospace structural components. The deep learning method represented by the convolutional neural network (CNN) has received extensive attention in welding radiographic image recognition (WRIR) owing to its powerful feature adaptive extraction ability. However, CNN-based WRIR faces key challenges of small sample size and poor explainability. Inspired by the process of interpreting radiographic film by experts, expert knowledge-empowered CNN for WRIR is proposed. Two self-supervised learning (SSL) tasks for radiographic image deblurring and brightness adjustment are designed to model expert experience. The expert knowledge learned from the SSL process is used to guide the CNN to identify weld defects. The results show that the proposed method improves the inductive bias of the CNN model, owns a faster convergence speed and recognition accuracy under the condition of small sample size, and reaches 97.65% of the comprehensive evaluation index F1-score. Moreover, the expert knowledge learned from the SSL process and the decision-making basis of the CNN model are visualized from both global and local aspects, which improve the explainability of CNN-based WRIR.
AB - Non-destructive testing of welds based on the radiographic image is crucial for improving the reliability of aerospace structural components. The deep learning method represented by the convolutional neural network (CNN) has received extensive attention in welding radiographic image recognition (WRIR) owing to its powerful feature adaptive extraction ability. However, CNN-based WRIR faces key challenges of small sample size and poor explainability. Inspired by the process of interpreting radiographic film by experts, expert knowledge-empowered CNN for WRIR is proposed. Two self-supervised learning (SSL) tasks for radiographic image deblurring and brightness adjustment are designed to model expert experience. The expert knowledge learned from the SSL process is used to guide the CNN to identify weld defects. The results show that the proposed method improves the inductive bias of the CNN model, owns a faster convergence speed and recognition accuracy under the condition of small sample size, and reaches 97.65% of the comprehensive evaluation index F1-score. Moreover, the expert knowledge learned from the SSL process and the decision-making basis of the CNN model are visualized from both global and local aspects, which improve the explainability of CNN-based WRIR.
KW - Convolutional neural network
KW - Explainable deep learning
KW - Non-destructive testing
KW - Self-supervised learning
KW - Welding radiographic image
UR - http://www.scopus.com/inward/record.url?scp=85152603874&partnerID=8YFLogxK
U2 - 10.1016/j.aei.2023.101963
DO - 10.1016/j.aei.2023.101963
M3 - Journal article
AN - SCOPUS:85152603874
SN - 1474-0346
VL - 56
JO - Advanced Engineering Informatics
JF - Advanced Engineering Informatics
M1 - 101963
ER -