Enhancing dynamic ECG heartbeat classification with lightweight transformer model

• Published in: Artificial intelligence in medicine Vol. 124; p. 102236
• Main Authors: Meng, Lingxiao, Tan, Wenjun, Ma, Jiangang, Wang, Ruofei, Yin, Xiaoxia, Zhang, Yanchun
• Format: Journal Article
• Language: English
• Published: Netherlands Elsevier B.V 01.02.2022
• Subjects: Algorithms; Arrhythmia detection; Attention; Deep learning; ECG classification; Electrocardiography - methods; Heart Rate; Neural Networks, Computer; Signal Processing, Computer-Assisted; Transformer; Deep learning; Arrhythmia detection; Transformer; ECG classification; Attention
• ISSN: 0933-3657; 1873-2860; 1873-2860
• DOI: 10.1016/j.artmed.2022.102236

Arrhythmia is a common class of Cardiovascular disease which is the cause for over 31% of all death over the world, according to WHOs' report. Automatic detection and classification of arrhythmia, as an effective tool of early warning, has recently been received more and more attention, especially in the applications of wearable devices for data capturing. However, different from traditional application scenarios, wearable electrocardiogram (ECG) devices have some drawbacks, such as being subject to multiple abnormal interferences, thus making accurate ventricular contraction (PVC) and supraventricular premature beat (SPB) detection to be more challenging. The traditional models for heartbeat classification suffer from the problem of large-scale parameters and the performance in dynamic ECG heartbeat classification is not satisfactory. In this paper, we propose a novel light model Lightweight Fussing Transformer to address these problems. We developed a more lightweight structure named LightConv Attention (LCA) to replace the self-attention of Fussing Transformer. LCA has reached remarkable performance level equal to or higher than self-attention with fewer parameters. In particular, we designed a stronger embedding structure (Convolutional Neural Network with attention mechanism) to enhance the weight of features of internal morphology of the heartbeat. Furthermore, we have implemented the proposed methods on real datasets and experimental results have demonstrated outstanding accuracy of detecting PVC and SPB. •Taking on the challenging task of dynamic ECG heartbeat accurate classification.•A novel light model, Lightweight Fussing Transformer, to address low data quality problem on dynamic ECG.•An extensive experimental evaluation over shows that the techniques outperform previous approaches.•Results indicate that the proposed methods are able to yield acceptable results and can be deployed in wearable device.