Enhancing the detection of atrial fibrillation from wearable sensors with neural style transfer and convolutional recurrent networks

• Published in: Computers in biology and medicine Vol. 146; p. 105551
• Main Authors: Xiong, Zhaohan, Stiles, Martin K., Gillis, Anne M., Zhao, Jichao
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.07.2022; Elsevier Limited
• Subjects: Accuracy; Algorithms; Arrhythmia; Atrial fibrillation; Automation; Cardiac arrhythmia; Convolutional recurrent networks; Coronary artery disease; Data augmentation; Data synthesis; Datasets; Deep learning; EKG; Electrocardiography; Electronic devices; Fibrillation; Heart diseases; Heart rate; Internal Medicine; Machine learning; Mathematical models; Methods; Morphology; Neural style transfer; Ordinary differential equations; Other; Patients; Portable equipment; Robustness (mathematics); Signal processing; Smartwatches; Synthesis; Variables; United States > US; California; Convolutional recurrent networks; Neural style transfer; Atrial fibrillation; Data synthesis
• ISSN: 0010-4825; 1879-0534; 1879-0534
• DOI: 10.1016/j.compbiomed.2022.105551

Electrocardiograms (ECG) provide an effective, non-invasive approach for clinical diagnosis and monitoring treatment in patients with cardiac diseases including the most common cardiac arrhythmia, atrial fibrillation (AF). Portable ECG recording devices including Apple Watch and Kardia devices have been developed for AF detection. However, the efficacy of these smart devices has not been fully validated. We aimed to develop an open-source deep learning framework for automatic AF detection using the largest publicly available single-lead ECG dataset through a mobile Kardia device enhanced with style transfer-driven data augmentation. We developed and validated a 37-layer convolutional recurrent network (CRN) using 5,834 single-lead ECGs with a mean length of 30 seconds from the 2017 PhysioNet Challenge to automatically detect sinus rhythm and AF. To address the challenge of a lack of a large number of AF samples, we proposed a novel style transfer generator that fuses patient-specific clinical ECGs and mathematically modelled ECG features to synthesize realistic ECGs by five-fold. The differences between synthesized and clinical ECGs were analyzed by studying their average ECG morphologies and frequency distributions. Our results indicated the style transfer-driven data augmentation was not classifier-dependent. Validation on 2,917 clinical ECGs showed an F1 score of 96.4%, with the generated ECGs contributing to a 3% improvement in AF detection for the Kardia event recorder. By developing and evaluating our approach on an open-source ECG dataset, we have demonstrated that our framework is both robust and verifiable, and potentially can be used in portable devices for effective AF classification. [Display omitted] •Designed a CRN for automatic AF and SR classification from single-lead ECGs.•Methods developed on the world's largest open-source ECG dataset.•Synthesized realistic ECGs with mathematical modelling and neural style transfer.•Synthetic ECGs improved the accuracy of the CRN for AF detection by 3%.