An expert knowledge-empowered CNN approach for welding radiographic image recognition

Tianyuan Liu, Hangbin Zheng, Pai Zheng, Jinsong Bao, Junliang Wang, Xiaojia Liu, Changqi Yang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

28 Citations (Scopus)

Abstract

Non-destructive testing of welds based on the radiographic image is crucial for improving the reliability of aerospace structural components. The deep learning method represented by the convolutional neural network (CNN) has received extensive attention in welding radiographic image recognition (WRIR) owing to its powerful feature adaptive extraction ability. However, CNN-based WRIR faces key challenges of small sample size and poor explainability. Inspired by the process of interpreting radiographic film by experts, expert knowledge-empowered CNN for WRIR is proposed. Two self-supervised learning (SSL) tasks for radiographic image deblurring and brightness adjustment are designed to model expert experience. The expert knowledge learned from the SSL process is used to guide the CNN to identify weld defects. The results show that the proposed method improves the inductive bias of the CNN model, owns a faster convergence speed and recognition accuracy under the condition of small sample size, and reaches 97.65% of the comprehensive evaluation index F1-score. Moreover, the expert knowledge learned from the SSL process and the decision-making basis of the CNN model are visualized from both global and local aspects, which improve the explainability of CNN-based WRIR.

Original languageEnglish
Article number101963
Number of pages12
JournalAdvanced Engineering Informatics
Volume56
DOIs
Publication statusPublished - Apr 2023

Keywords

  • Convolutional neural network
  • Explainable deep learning
  • Non-destructive testing
  • Self-supervised learning
  • Welding radiographic image

ASJC Scopus subject areas

  • Information Systems
  • Building and Construction
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'An expert knowledge-empowered CNN approach for welding radiographic image recognition'. Together they form a unique fingerprint.

Cite this