TY - JOUR
T1 - ALADA: A Lite Automatic Data Augmentation Framework for Industrial Defect Detection
AU - Wang, Yuxuan
AU - Chung, Sai Ho
AU - Khan, Waqar Ahmed
AU - Wang, Tianteng
AU - Xu, David Jingjun
N1 - Funding information:
This work was supported by a grant from the Research Committee of The Hong Kong Polytechnic University under the Account Code RK3G.
Publisher Copyright:
© 2023 Elsevier Ltd
PY - 2023/10/1
Y1 - 2023/10/1
N2 - Industrial defect detection is a critical and challenging task in the quality control of manufacturing production. Competent in feature extraction and pattern recognition, deep learning shows great power for classifying and locating defects in industrial products. However, insufficient data records and diverse categories of defects restrict the detection accuracy of data-driven neural networks. One direction to solve such a problem is data augmentation, which aims at generating synthetic copies from existing data and improving the generalizability of detection models. However, confirming a suitable augmentation policy involves either human experience or substantial experiments for augmentation parameters. To address these challenges, in this work, a lite automatic data augmentation (ALADA) framework is proposed to jointly optimize the data augmentation policies and the neural network for industrial defect detection. First, a lite search space is formulated to efficiently sample augmentation policies and generate augmented images for joint optimization. To reduce the hyperparameter tuning efforts for retraining with searched policies, a three-step bi-level optimization scheme is proposed to replace the retraining strategy and update the model and augmentation parameter alternately. To solve the non-differentiable problem in the joint optimization scheme, policy gradient sampling is implemented to estimate the gradient flow efficiently. Experimental results on three industrial defect detection datasets, namely, Tianchi-TILE, GC10-DET, and NEU-DET, reveal that our proposed automatic augmentation framework outperforms the state-of-the-art augmentation methods and effectively improves the accuracy of the baseline defect detection model. The proposed ALADA scheme also alleviates the missed detection of defects in four practical industrial circumstances: textured background, uneven brightness, low contrast, and intraclass difference.
AB - Industrial defect detection is a critical and challenging task in the quality control of manufacturing production. Competent in feature extraction and pattern recognition, deep learning shows great power for classifying and locating defects in industrial products. However, insufficient data records and diverse categories of defects restrict the detection accuracy of data-driven neural networks. One direction to solve such a problem is data augmentation, which aims at generating synthetic copies from existing data and improving the generalizability of detection models. However, confirming a suitable augmentation policy involves either human experience or substantial experiments for augmentation parameters. To address these challenges, in this work, a lite automatic data augmentation (ALADA) framework is proposed to jointly optimize the data augmentation policies and the neural network for industrial defect detection. First, a lite search space is formulated to efficiently sample augmentation policies and generate augmented images for joint optimization. To reduce the hyperparameter tuning efforts for retraining with searched policies, a three-step bi-level optimization scheme is proposed to replace the retraining strategy and update the model and augmentation parameter alternately. To solve the non-differentiable problem in the joint optimization scheme, policy gradient sampling is implemented to estimate the gradient flow efficiently. Experimental results on three industrial defect detection datasets, namely, Tianchi-TILE, GC10-DET, and NEU-DET, reveal that our proposed automatic augmentation framework outperforms the state-of-the-art augmentation methods and effectively improves the accuracy of the baseline defect detection model. The proposed ALADA scheme also alleviates the missed detection of defects in four practical industrial circumstances: textured background, uneven brightness, low contrast, and intraclass difference.
KW - Industrial defect detection
KW - Automatic data augmentation
KW - Deep learning
KW - Optimization
UR - https://www.scopus.com/record/display.uri?eid=2-s2.0-85174956354&origin=inward
U2 - 10.1016/j.aei.2023.102205
DO - 10.1016/j.aei.2023.102205
M3 - Journal article
SN - 1474-0346
VL - 58
JO - Advanced Engineering Informatics
JF - Advanced Engineering Informatics
M1 - 102205
ER -