A novel approach for text categorization by applying hybrid genetic bat algorithm through feature extraction and feature selection methods

• Published in: Expert systems with applications Vol. 202; p. 117433
• Main Authors: Eligüzel, Nazmiye, Çetinkaya, Cihan, Dereli, Türkay
• Format: Journal Article
• Language: English
• Published: New York Elsevier Ltd 15.09.2022; Elsevier BV
• Subjects: Algorithms; Bat algorithm; Classification; Clustering; Data analysis; Data collection; Datasets; Dirichlet problem; Documents; Feature extraction; Feature selection; Genetic algorithm; Social networks; Text categorization; Uncapacitated P-median problem; Feature extraction; Feature selection; Uncapacitated P-median problem; Bat algorithm; Genetic algorithm; Text categorization
• ISSN: 0957-4174; 1873-6793; 1873-6793
• DOI: 10.1016/j.eswa.2022.117433

•Application of uncapacitated P-median problem to obtain clustered tweets.•Applying a novel hybrid genetic bat algorithm on uncapacitated P-median problem.•Generation of a similarity matrix via Latent Dirichlet Allocation model.•Determining needs of the victims after an earthquake using Twitter data. Due to the rapid incline in the number of documents along with social media usage, text categorization has become an important concept. There are tasks required to be fulfilled during the text categorization, such as extracting useful data from different perspectives, reducing the high feature space dimension, and improving effectiveness. In order to accomplish these tasks, feature selection, and feature extraction gain importance. This paper investigates how to solve feature selection and extraction problems. Also, this study aims to decide which topics are the focus of a document. Moreover, the Twitter data-set is utilized as a document and an Uncapacitated P-Median Problem (UPMP) is applied to make clustering. In this study, UPMP is used on Twitter data collection for the first time to collect clustered tweets. Therefore, a novel hybrid genetic bat algorithm (HGBA) is proposed to solve the UPMP for our case. The proposed novel approach is applied to analyze the Twitter data-set of the Nepal earthquake. The first part of the analysis includes the data pre-processing stage. The Latent Dirichlet Allocation (LDA) method is applied to the pre-processed text. After that, a similarity (distance) matrix is generated by utilizing the Jensen Shannon Divergence (JSD) model. The study's main goal is to use Twitter to assess the needs of victims during and after a disaster. To evaluate the applicability of the proposed approach, experiments are conducted on the OR-Library data-set. The results demonstrate that the proposed approach successfully extracts topics and categorizes text.