CSS: Handling imbalanced data by improved clustering with stratified sampling

• Published in: Concurrency and computation Vol. 34; no. 2
• Main Authors: Cao, Lu, Shen, Hong
• Format: Journal Article
• Language: English
• Published: Hoboken, USA John Wiley & Sons, Inc 25.01.2022; Wiley Subscription Services, Inc
• Subjects: Algorithms; Classification; Classifiers; Clustering; clustering by fast search and find of density peaks; Datasets; ensemble learning; imbalanced data; Normal distribution; Oversampling; Sampling methods; stratified sampling; Support vector machines
• ISSN: 1532-0626; 1532-0634
• DOI: 10.1002/cpe.6071

Summary The traditional support vector machine technique (SVM) has drawbacks in dealing with imbalanced data. To address this issue, in this paper we propose an algorithm of improved clustering with stratified sampling technique (CSS) to improve the classification performance of SVMs on imbalanced datasets. Instead of applying a single type of sampling method as used in the literature, our algorithm treats different type of classes with different sampling methods. For minority classes, the algorithm uses oversampling method by adding noise which obeys normal distribution around every support vector to generate new samples. For majority classes, samples are first divided into different clusters by applying first the improved clustering by fast search to find of density peaks (CFSFDP) to obtain latent structure information in each majority class and then stratified sampling method is applied to extract samples from each subcluster of the majority class. Moreover, we further extend this method into an ensemble classifiers that use multiple base SVM classifiers for prediction. The experimental results of classification on several imbalanced classification datasets show that our CSS is more effective than the state‐of‐the‐art sampling methods.