Neural Network Entropy (NNetEn): Entropy-Based EEG Signal and Chaotic Time Series Classification, Python Package for NNetEn Calculation

• Published in: Algorithms Vol. 16; no. 5; p. 255
• Main Authors: Velichko, Andrei, Belyaev, Maksim, Izotov, Yuriy, Murugappan, Murugappan, Heidari, Hanif
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.05.2023
• Subjects: Algorithms; Analysis; Classification; Datasets; Distribution (Probability theory); Distribution functions; Electroencephalography; Emotions; Entropy; Entropy (Information theory); entropy features; Heart rate; neural network entropy; Neural networks; NNetEn; Probability distribution; Probability distribution functions; Python; Separation; Severe acute respiratory syndrome coronavirus 2; Signal classification; Software; Synergistic effect; Time series; time series classification
• ISSN: 1999-4893; 1999-4893
• DOI: 10.3390/a16050255

Entropy measures are effective features for time series classification problems. Traditional entropy measures, such as Shannon entropy, use probability distribution function. However, for the effective separation of time series, new entropy estimation methods are required to characterize the chaotic dynamic of the system. Our concept of Neural Network Entropy (NNetEn) is based on the classification of special datasets in relation to the entropy of the time series recorded in the reservoir of the neural network. NNetEn estimates the chaotic dynamics of time series in an original way and does not take into account probability distribution functions. We propose two new classification metrics: R2 Efficiency and Pearson Efficiency. The efficiency of NNetEn is verified on separation of two chaotic time series of sine mapping using dispersion analysis. For two close dynamic time series (r = 1.1918 and r = 1.2243), the F-ratio has reached the value of 124 and reflects high efficiency of the introduced method in classification problems. The electroencephalography signal classification for healthy persons and patients with Alzheimer disease illustrates the practical application of the NNetEn features. Our computations demonstrate the synergistic effect of increasing classification accuracy when applying traditional entropy measures and the NNetEn concept conjointly. An implementation of the algorithms in Python is presented.