A fast parameter optimization approach based on the inter-cluster induced distance in the feature space for support vector machines

• Published in: Applied soft computing Vol. 118; p. 108519
• Main Authors: Wang, Jiapeng, Luo, Jiaxiang
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.03.2022
• Subjects: Inter-cluster induced distance; Kernel parameter; Modified golden section algorithm; Parameter optimization; Support vector machine; Inter-cluster induced distance; Support vector machine; Modified golden section algorithm; Parameter optimization; Kernel parameter
• ISSN: 1568-4946; 1872-9681
• DOI: 10.1016/j.asoc.2022.108519

This paper focuses on the problem of optimizing the kernel and penalty parameters for SVM classifiers with Gaussian kernel. To reduce the computational overhead of inter-cluster distance in the feature space (ICDF) with a large number of candidate discretized values in a large interval in previous researches, in this paper, the new inter-cluster induced distance in the feature space (ICIDF) is proposed to guide the kernel parameter selection of SVMs, and the theorem that the ICIDF is a positive strictly unimodal function about Gaussian kernel parameter is firstly presented. Then, a fast parameter optimization approach including two stages is presented for SVMs according to this theorem. In the first stage, a modified golden section algorithm (MGSA) is proposed to obtain a shrunk value interval for kernel parameter in small amount of ICIDF calculations. In the second stage, a differential evolutionary algorithm (BBDE or SADE) is applied to select the best parameter combination for SVM in the shrunk interval of kernel parameter obtained by MGSA and a given interval of penalty parameter. Experiments for benchmark datasets illustrate that the training time of SVM models can significantly shortened by our approach, while the testing accuracy of the trained SVMs is competitive. •The ICIDF is proposed to guide the kernel parameter selection of SVM classifiers.•The theorem that ICIDF is a positive strictly unimodal function is first presented.•A modified golden section algorithm is proposed to search for the largest ICIDF.•The new fast algorithmic framework is proposed to optimize the parameters for SVM.•The proposed fast hybrid approach includes two stages.