Regular Papers

International Journal of Control, Automation, and Systems 2024; 22(8): 2644-2657

https://doi.org/10.1007/s12555-023-0721-z

© The International Journal of Control, Automation, and Systems

Anomaly Detection With Transformer for a Railway Vehicle Air Compressor

Min-Je Jin and Chul-Goo Kang*

Konkuk University

Abstract

Recently, research on condition-based maintenance (CBM) using artificial intelligence has attracted attention to reduce the maintenance costs of railway vehicles. The air compressor of a railway vehicle that adopts an air brake system is a target for CBM, and in order to reduce maintenance costs and ensure driving stability, technology to detect anomalies in the air compressor is necessary. The long short-term memory (LSTM) autoencoder is used to process sequence data. However, LSTM has limitations in that it cannot perform parallel processing due to its recurrent neural network characteristics, and it is difficult to learn the dependency between data as the sequence data lengthens. In this paper, we propose a novel transformer architecture as an anomaly detection model to learn dependency between air compressor data of a railway vehicle and we demonstrate superior data reconstruction and generalization ability of proposed transformer. We conduct simulation tests based on actual railway vehicle air compressor data and confirm improved anomaly detection performance. We propose an anomaly score definition method using mean squared error to perform reconstruction error-based anomaly detection. With the successful anomaly detection results in the air compressor of a railway vehicle, we demonstrate the effectiveness of a proposed anomaly detection algorithm that applies the moving average of anomaly scores and defines anomaly criteria using three-sigma. We test the proposed anomaly detection method using sensor data received from actual urban railway air compressors and prove its usefulness.

Keywords Air compressor, anomaly detection, autoencoder, condition-based maintenance, LSTM, railway vehicle, transformer.

Article

Regular Papers

International Journal of Control, Automation, and Systems 2024; 22(8): 2644-2657

Published online August 1, 2024 https://doi.org/10.1007/s12555-023-0721-z

Copyright © The International Journal of Control, Automation, and Systems.

Anomaly Detection With Transformer for a Railway Vehicle Air Compressor

Min-Je Jin and Chul-Goo Kang*

Konkuk University

Abstract

Recently, research on condition-based maintenance (CBM) using artificial intelligence has attracted attention to reduce the maintenance costs of railway vehicles. The air compressor of a railway vehicle that adopts an air brake system is a target for CBM, and in order to reduce maintenance costs and ensure driving stability, technology to detect anomalies in the air compressor is necessary. The long short-term memory (LSTM) autoencoder is used to process sequence data. However, LSTM has limitations in that it cannot perform parallel processing due to its recurrent neural network characteristics, and it is difficult to learn the dependency between data as the sequence data lengthens. In this paper, we propose a novel transformer architecture as an anomaly detection model to learn dependency between air compressor data of a railway vehicle and we demonstrate superior data reconstruction and generalization ability of proposed transformer. We conduct simulation tests based on actual railway vehicle air compressor data and confirm improved anomaly detection performance. We propose an anomaly score definition method using mean squared error to perform reconstruction error-based anomaly detection. With the successful anomaly detection results in the air compressor of a railway vehicle, we demonstrate the effectiveness of a proposed anomaly detection algorithm that applies the moving average of anomaly scores and defines anomaly criteria using three-sigma. We test the proposed anomaly detection method using sensor data received from actual urban railway air compressors and prove its usefulness.

Keywords: Air compressor, anomaly detection, autoencoder, condition-based maintenance, LSTM, railway vehicle, transformer.

IJCAS
February 2025

Vol. 23, No. 2, pp. 359~682

Stats or Metrics

Share this article on

  • line

Related articles in IJCAS

IJCAS

eISSN 2005-4092
pISSN 1598-6446