Dominant Data Set Selection Algorithms for Electricity Consumption Time-Series Data Analysis Based on Affine Transformation

• Published in: IEEE internet of things journal Vol. 7; no. 5; pp. 4347 - 4360
• Main Authors: Wu, Yi, Liu, Yi, Ahmed, Syed Hassan, Peng, Jialiang, Abd El-Latif, Ahmed A.
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.05.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Affine transformation; Affine transformations; Algorithms; Big Data; Complexity; Correlation; Data analysis; Data mining; Datasets; dominant data set; Electricity consumption; Error analysis; Greedy algorithms; Internet of Things; Kernels; linear correlation; Power systems; Real-time systems; Redundancy; time-series data (TSD)
• ISSN: 2327-4662; 2327-4662
• DOI: 10.1109/JIOT.2019.2946753

In the explosive growth of time-series data (TSD), the scale of TSD suggests that the scale and capability of many Internet of Things (IoT)-based applications has already been exceeded. Moreover, redundancy persists in TSD due to the correlation between information acquired via different sources. In this article, we propose a cohort of dominant data set selection algorithms for electricity consumption TSD with a focus on discriminating the dominant data set that is a small data set but capable of representing the kernel information carried by TSD with an arbitrarily small error rate less than <inline-formula> <tex-math notation="LaTeX">\varepsilon </tex-math></inline-formula>. Furthermore, we prove that the selection problem of the minimum dominant data set is an NP-complete problem. The affine transformation model is introduced to define the linear correlation relationship between TSD objects. Our proposed framework consists of the scanning selection algorithm with <inline-formula> <tex-math notation="LaTeX">O({n^{3}}) </tex-math></inline-formula> time complexity and the greedy selection algorithm with <inline-formula> <tex-math notation="LaTeX">O({n^{4}}) </tex-math></inline-formula> time complexity, which are, respectively, proposed to select the dominant data set based on the linear correlation distance between TSD objects. The proposed algorithms are evaluated on the real electricity consumption data of Harbin city in China. The experimental results show that the proposed algorithms not only reduce the size of the extracted kernel data set but also ensure the TSD integrity in terms of accuracy and efficiency.