MINAS: multiclass learning algorithm for novelty detection in data streams

• Published in: Data mining and knowledge discovery Vol. 30; no. 3; pp. 640 - 680
• Main Authors: de Faria, Elaine Ribeiro, Ponce de Leon Ferreira Carvalho, André Carlos, Gama, João
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.05.2016; Springer Nature B.V
• Subjects: Active learning; Algorithms; Artificial Intelligence; Chemistry and Earth Sciences; Classification; Computer Science; Construction; Consumer goods; Data mining; Data Mining and Knowledge Discovery; Data transmission; Datasets; Evolution; Experiments; Information Storage and Retrieval; Physics; Statistics for Engineering; Tasks; Concept evolution; Data streams; Multiclass classification; Novelty detection
• ISSN: 1384-5810; 1573-756X; 1573-756X
• DOI: 10.1007/s10618-015-0433-y

Data stream mining is an emergent research area that aims at extracting knowledge from large amounts of continuously generated data. Novelty detection (ND) is a classification task that assesses if one or a set of examples differ significantly from the previously seen examples. This is an important task for data stream, as new concepts may appear, disappear or evolve over time. Most of the works found in the ND literature presents it as a binary classification task. In several data stream real life problems, ND must be treated as a multiclass task, in which, the known concept is composed by one or more classes and different new classes may appear. This work proposes MINAS, an algorithm for ND in data streams. MINAS deals with ND as a multiclass task. In the initial training phase, MINAS builds a decision model based on a labeled data set. In the online phase, new examples are classified using this model, or marked as unknown . Groups of unknown examples can be used later to create valid novelty patterns (NP), which are added to the current model. The decision model is updated as new data come over the stream in order to reflect changes in the known classes and allow the addition of NP. This work also presents a set of experiments carried out comparing MINAS and the main novelty detection algorithms found in the literature, using artificial and real data sets. The experimental results show the potential of the proposed algorithm.