A novel selective naïve Bayes algorithm

• Published in: Knowledge-based systems Vol. 192; p. 105361
• Main Authors: Chen, Shenglei, Webb, Geoffrey I., Liu, Linyuan, Ma, Xin
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 15.03.2020; Elsevier Science Ltd
• Subjects: Algorithms; Attribute selection; Bayesian analysis; Data mining; Feature selection; Leave-one-out cross validation; Model selection; Naïve Bayes; Naïve Bayes; Attribute selection; Model selection; Leave-one-out cross validation
• ISSN: 0950-7051; 1872-7409
• DOI: 10.1016/j.knosys.2019.105361

Naïve Bayes is one of the most popular data mining algorithms. Its efficiency comes from the assumption of attribute independence, although this might be violated in many real-world data sets. Many efforts have been done to mitigate the assumption, among which attribute selection is an important approach. However, conventional efforts to perform attribute selection in naïve Bayes suffer from heavy computational overhead. This paper proposes an efficient selective naïve Bayes algorithm, which adopts only some of the attributes to construct selective naïve Bayes models. These models are built in such a way that each one is a trivial extension of another. The most predictive selective naïve Bayes model can be selected by the measures of incremental leave-one-out cross validation. As a result, attributes can be selected by efficient model selection. Empirical results demonstrate that the selective naïve Bayes shows superior classification accuracy, yet at the same time maintains the simplicity and efficiency.