International Journal of Control, Automation, and Systems 2023; 21(9): 3105-3115
https://doi.org/10.1007/s12555-021-0981-4
© The International Journal of Control, Automation, and Systems
Using deep learning (DL) technology, neural networks have achieved great success in various fields of computer vision. Among them, anomaly detection is a promising application of image defect analysis. The purpose of the detector is to find the out-of-distribution when predicting the probability of a DL network for abnormal samples, after some normal sample images are given for training. Geometric transformation (GT) based anomaly detection is one of the recent best methods for classifying abnormal samples among many normal ones. However, the GT method training process is unstable and too inaccurate to be used in industrial applications. The goal of this study is to suggest a method to improve the performance of a GT-based anomaly detector (GTnet). Using observations of GTnet behavior and its training properties, we propose the addition of three techniques that can improve anomaly detection performance for defect inspection in a factory production process. Specifically, k-Winners-Take-All (kWTA) was applied to the GTnet base model to resist data corruption such as dust on the sample, the temperature scaling method was added to consider correlations between GT classes with similar appearance, and loss redefinition was applied to improve the efficiency of optimal training. Accuracy was improved from 98.56% to 99.86% in the inspection of vehicle part assembly defects, which requires extremely high accuracy. Experimental evaluations were conducted to verify the performance improvement of the GT anomaly detector.
Keywords Anomaly detection, calibration, focal loss, geometric transformation, k-WTA.
International Journal of Control, Automation, and Systems 2023; 21(9): 3105-3115
Published online September 1, 2023 https://doi.org/10.1007/s12555-021-0981-4
Copyright © The International Journal of Control, Automation, and Systems.
Hyun-Soo Kim and Dong-Joong Kang*
Pusan National University
Using deep learning (DL) technology, neural networks have achieved great success in various fields of computer vision. Among them, anomaly detection is a promising application of image defect analysis. The purpose of the detector is to find the out-of-distribution when predicting the probability of a DL network for abnormal samples, after some normal sample images are given for training. Geometric transformation (GT) based anomaly detection is one of the recent best methods for classifying abnormal samples among many normal ones. However, the GT method training process is unstable and too inaccurate to be used in industrial applications. The goal of this study is to suggest a method to improve the performance of a GT-based anomaly detector (GTnet). Using observations of GTnet behavior and its training properties, we propose the addition of three techniques that can improve anomaly detection performance for defect inspection in a factory production process. Specifically, k-Winners-Take-All (kWTA) was applied to the GTnet base model to resist data corruption such as dust on the sample, the temperature scaling method was added to consider correlations between GT classes with similar appearance, and loss redefinition was applied to improve the efficiency of optimal training. Accuracy was improved from 98.56% to 99.86% in the inspection of vehicle part assembly defects, which requires extremely high accuracy. Experimental evaluations were conducted to verify the performance improvement of the GT anomaly detector.
Keywords: Anomaly detection, calibration, focal loss, geometric transformation, k-WTA.
Vol. 21, No. 9, pp. 2771~3126
Xinyao Xu, Fangbo Qin, Wenjun Zhao, De Xu*, Xingang Wang, and Xihao Yang
International Journal of Control, Automation and Systems 2022; 20(6): 1827-1840Gu-Yin Rao*, Guo-Chen Wang, Song-Lai Han, and Wen Zhang
International Journal of Control, Automation and Systems 2015; 13(4): 960-966Yong-Deuk Shin, Jae-Han Park, Ji-Hun Bae, and Moon-Hong Baeg*
International Journal of Control, Automation and Systems 2012; 10(1): 109-116