A Novel Rotation Forest Modality Based On Hybrid NNs: RF (ScPSO-NN)

• Published in: Journal of King Saud University. Computer and information sciences Vol. 31; no. 2; pp. 235 - 251
• Main Authors: Ceylan, Rahime, Koyuncu, Hasan
• Format: Journal Article
• Language: English
• Published: جامعة الملك سعود 01.04.2019; Elsevier B.V; Elsevier
• Subjects: Artificial Bee Colony Optimization; Hybrid classifiers; Particle Swarm Optimization; Rotation Forest; Scout Particle Swarm Optimization; الخوارزميات; علوم الحاسوب; قواعد البيانات; Artificial Bee Colony Optimization; Rotation Forest; Scout Particle Swarm Optimization; Hybrid classifiers; Particle Swarm Optimization
• ISSN: 1319-1578; 2213-1248; 2213-1248
• DOI: 10.1016/j.jksuci.2017.10.011

Neural Network (NN), hybrid NN methods and Rotation Forest (RF) ensemble classifier are preferred in pattern analysis owing to their ability for finding efficient solutions on different problems. NN architecture usually includes backpropagation type algorithms in which error is exposed to fluctuations. Hybrid NN methods are generally designed to improve the classification performance of NN. Scout Particle Swarm Optimization (ScPSO) is one of these optimization algorithms including the effective parts of Particle Swarm Optimization (PSO) and Artificial Bee Colony Optimization (ABC). Moreover, RF algorithm usually indicates the same performance as in hybrid NN methods, although it is comprised of Decision Tree (DT) classifiers. At this point, our paper investigates whether RF using the hybrid NNs can outperform other ensemble classifiers in binary-medical pattern classification, or not. With this intention, PSO, ABC and ScPSO are placed in NN algorithms instead of back propagation, and hybrid methods (PSO-NN, ABC-NN and ScPSO-NN) are realized. As a result, RF (PSO-NN), RF (ABC-NN) and RF (ScPSONN) architectures are obtained. Classification Accuracy (CA), Area Under Curve (AUC), Sensitivity, Specificity, F-measure, Gmean and Precision metrics are used for a statistical performance comparison, and a test based on 2-fold cross validation method was realized on five medical datasets. © 2017 The Authors. Production and hosting by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).