A Hierarchical Bayes-Based Evolutionary Ensemble Classification Algorithm

• Published in: 2022 5th International Conference on Pattern Recognition and Artificial Intelligence (PRAI) pp. 138 - 146
• Main Authors: Zhang, Lei, Chu, Ziyue, Liang, Longfei, Yang, Wen-Chi
• Format: Conference Proceeding
• Language: English
• Published: IEEE 19.08.2022
• Subjects: Bayes ensemble; Classification algorithms; Deep learning; genetic algorithm; Genetics; gradient-free; Industries; multi-class classification; Neural networks; Optimization methods; Pattern recognition; posterior-based class similarity
• DOI: 10.1109/PRAI55851.2022.9904224

Regarding a multi-label classification task, the different similarities between targeted categories are commonly overlooked in front of deep neural network models. Never-theless, decomposing the large-scale multi-label classification problem into a series of hierarchical sub-problems based on their similarity information can reduce the problem dimension and result in lower computational cost with competitive performance. This paper proposed a Hierarchical Bayes-based Evolutionary Ensemble (HBEE) classification algorithm that computes and utilises our new data-driven posterior-based class similarity to evolve a tree of weak classifiers. The posterior information is gathered from a reduced Bayes theorem, which is insensitive to imbalanced data amount and imbalanced inter-class similarities. Instead of doing gradient descent optimization on large scale parameters, a gradient-free optimization method, genetic technique, is adopted for a series of weak classifier's ensemble decision, which is extremely useful in industry when large scale gradient optimization method is not feasible.