Where Are We Going? Predicting the Evolution of Individuals

• Published in: Advances in Intelligent Data Analysis XI pp. 357 - 368
• Main Authors: Siddiqui, Zaigham Faraz, Oliveira, Márcia, Gama, João, Spiliopoulou, Myra
• Format: Book Chapter
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2012
• Series: Lecture Notes in Computer Science
• Subjects: cluster transition; clustering; data streams; evolutionary data mining; label prediction; perennial objects
• ISBN: 9783642341557; 3642341551
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-642-34156-4_33

When searching for patterns on data streams, we come across perennial (dynamic) objects that evolve over time. These objects are encountered repeatedly and each time with different definition and values. Examples are (a) companies registered at stock exchange and reporting their progress at the end of each year, and (b) students whose performance is evaluated at the end of each semester. On such data, domain experts also pose questions on how the individual objects will evolve: would it be beneficial to invest in a given company, given both the company’s individual performance thus far and the drift experienced in the model? Or, how will a given student perform next year, given the performance variations observed thus far? While there is much research on how models evolve/change over time [Ntoutsi et al., 2011a], little is done to predict the change of individual objects when the states are not known a priori. In this work, we propose a framework that learns the clusters to which the objects belong at each moment, uses them as ad hoc states in a state-transition graph, and then learns a mixture model of Markov Chains, which predicts the next most likely state/cluster per object. We report on our evaluation on synthetic and real datasets.