Multi-head CNN–RNN for multi-time series anomaly detection: An industrial case study

• Published in: Neurocomputing (Amsterdam) Vol. 363; pp. 246 - 260
• Main Authors: Canizo, Mikel, Triguero, Isaac, Conde, Angel, Onieva, Enrique
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 21.10.2019
• Subjects: Anomaly detection; Convolutional neural networks; Deep learning; Industry 4.0; Multi-sensor systems; Recurrent neural networks; Deep learning; Multi-sensor systems; Recurrent neural networks; Industry 4.0; Convolutional neural networks; Anomaly detection
• ISSN: 0925-2312; 1872-8286; 1872-8286
• DOI: 10.1016/j.neucom.2019.07.034

•We propose a Multi-head CNN-RNN for multi-time series anomaly detection.•Time series are addressed independently to deal with heterogeneous sensor systems.•The Multi-head CNN can adapt its heads to the needs of each time series•The Multi-head CNN-RNN adapts to new sensor configurations using transfer learning.•An industrial case study with elevator data is used to test the proposed method.•Experiments show promising results detecting anomalies in an industrial scenario. Detecting anomalies in time series data is becoming mainstream in a wide variety of industrial applications in which sensors monitor expensive machinery. The complexity of this task increases when multiple heterogeneous sensors provide information of different nature, scales and frequencies from the same machine. Traditionally, machine learning techniques require a separate data pre-processing before training, which tends to be very time-consuming and often requires domain knowledge. Recent deep learning approaches have shown to perform well on raw time series data, eliminating the need for pre-processing. In this work, we propose a deep learning based approach for supervised multi-time series anomaly detection that combines a Convolutional Neural Network (CNN) and a Recurrent Neural Network (RNN) in different ways. Unlike other approaches, we use independent CNNs, so-called convolutional heads, to deal with anomaly detection in multi-sensor systems. We address each sensor individually avoiding the need for data pre-processing and allowing for a more tailored architecture for each type of sensor. We refer to this architecture as Multi-head CNN–RNN. The proposed architecture is assessed against a real industrial case study, provided by an industrial partner, where a service elevator is monitored. Within this case study, three type of anomalies are considered: point, context-specific, and collective.The experimental results show that the proposed architecture is suitable for multi-time series anomaly detection as it obtained promising results on the real industrial scenario.