A novel multi-objective genetic algorithm based error correcting output codes

• Published in: Swarm and evolutionary computation Vol. 57; p. 100709
• Main Authors: Zhang, Yu-Ping, Ye, Xiao-Na, Liu, Kun-Hong, Yao, Jun-Feng
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.09.2020
• Subjects: Error correcting output codes (ECOC); Genetic algorithm (GA); Heterogeneous ensemble; Multi-objective; Multiclass classification; Pairwise diversity; Error correcting output codes (ECOC); Heterogeneous ensemble; Genetic algorithm (GA); Pairwise diversity; Multi-objective; Multiclass classification
• ISSN: 2210-6502
• DOI: 10.1016/j.swevo.2020.100709

Up to now, different genetic algorithm (GA) based error correcting output codes (ECOC) algorithms have been proposed by setting accuracy as the optimization objective. However, it was demonstrated that diversity among learners is of great significance to a robust ensemble. In this paper, we propose a multi-objective GA with setting accuracy and diversity as two objectives. To further promote diversity in an ensemble, a new individual structure is designed to accommodate heterogeneous dichotomizers. Three multi-objective ranking strategies are deployed to balance two objectives respectively. A novel genetic operator is designed to produce ECOC-compatible offspring in the evolutionary process, and a local improvement algorithm is designed to promote individuals’ fitness values. To verify the performance of our GA, a single objective ranking strategy and the design of homogeneous learner based GA are also adopted. Ten widely used ECOC algorithms and three famous ensemble algorithms are deployed for performance comparisons based on a set of the UCI data and microarray data sets. Results show that compared with other algorithms, our GA obtains higher performance in most cases due to the trade-off between performance and diversity. Besides, the accommodation of heterogeneous dichotomizers in an ensemble provides higher generalization ability compared with homogeneous ensembles. •A novel ECOC algorithm is proposed based on the Multi-Objective Genetic Algorithm.•The accuracy of an ensemble and pairwise diversity are set to two objectives.•A new individual structure is designed to accommodate different types of learners, building a heterogeneous ensemble.•A local optimization algorithm is designed to improve the quality of each individual.•Compared with homogeneous based ECOC algorithms, our heterogeneous ECOC ensemble offers higher generalization ability.