Neural network ensembles based on copula methods and Distributed Multiobjective Central Force Optimization algorithm

• Published in: Engineering applications of artificial intelligence Vol. 32; pp. 203 - 212
• Main Authors: Chao, Meng, Xin, Sun Zhi, Min, Liu San
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.06.2014
• Subjects: Algorithms; Artificial intelligence; Central force optimization; Classification; Copula function; Ensemble neural network; Expert systems; Networks; Neural networks; Optimization; Regularization; Ensemble neural network; Copula function; Central force optimization
• ISSN: 0952-1976; 1873-6769
• DOI: 10.1016/j.engappai.2014.02.009

Copula is a function with multivariate distribution. It has uniformly distributed marginals. Central Force Optimization is a new algorithm which is based on kinematics. It has been illustrated that this algorithm is better than other heuristic methods, when these techniques are applied to the classification problems. This paper proposes a technique of neural network ensembles which use the distributed Central Force algorithm to optimize each individual component network, simultaneously. The distributed Central Force algorithm incorporates an additional regularization term and utilizes the multiobjective architectures to design component networks. Furthermore it proposes that a new method of combining the component networks is to use Copula function theory as an effective design tool which generates the combining weights. The experimental results show that the copula-based ensemble network achieves better performance than other ensemble methods and that Distributed Multiobjective Central Force Optimization is capable of achieving better solutions in the light of converging speed and local minima. In the experimental discussion, the paper gives several reasons why the proposed method outperforms others. [Display omitted] •Employ copula theory to generate the combining weights.•Apply the gravitational kinematics theory to the proof of the CFO algorithm convergence.•Implement the CFO algorithm using distributed multiobjective architecture.•Use the DMCFO to train the component network.