Particle swarm optimization algorithm based on comprehensive scoring framework for high-dimensional feature selection

• Published in: Swarm and evolutionary computation Vol. 95; p. 101915
• Main Authors: Wei, Bo, Yang, Shanshan, Zha, Wentao, Deng, Li, Huang, Jiangyi, Su, Xiaohui, Wang, Feng
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.06.2025
• Subjects: Comprehensive scoring framework; Evolutionary computing; Feature selection; Particle swarm optimization; Piecewise initialization strategy; Evolutionary computing; Piecewise initialization strategy; Feature selection; Comprehensive scoring framework; Particle swarm optimization
• ISSN: 2210-6502
• DOI: 10.1016/j.swevo.2025.101915

Feature selection (FS) plays an important role in data preprocessing. However, with the ever-increasing dimensionality of the dataset, most FS methods based on evolutionary computational (EC) face the challenge of “the dimensionality curse”. To address this challenge, we propose an new particle swarm optimization algorithm based on comprehensive scoring framework (PSO-CSM) for high-dimensional feature selection. First, a piecewise initialization strategy based on feature importance is used to initialize the population, which can help to obtain a diversity population and eliminate some redundant features. Then, a comprehensive scoring mechanism is proposed for screening important features. In this mechanism, a scaling adjustment factor is set to adjust the size of the feature space automatically. As the population continues to evolve, its feature space is further reduced so as to focus on the more promising area. Finally, a general comprehensive scoring framework (CSM) is designed to improve the performance of EC methods in FS task. The proposed PSO-CSM is compared with 10 representative FS algorithms on 18 datasets. The experimental results show that PSO-CSM is highly competitive in solving high-dimensional FS problems. •A piecewise initialization strategy can help to obtain a diversity population.•A comprehensive scoring mechanism is proposed to select important features.•The scaling adjustment factor is set to adjust the size of the feature space.•A general comprehensive scoring framework is designed for feature selection task.•The proposed algorithm has better dimensionality reduction effect.