Improving Student Performance Prediction Using a PCA-based Cuckoo Search Neural Network Algorithm

• Published in: Procedia computer science Vol. 225; pp. 4598 - 4610
• Main Authors: Ali, Maria, liaquat, Muhammad daniyal, Atta, Muhammad Nouman, Khan, Abdullah, Lashari, Saima Anwar, Ramli, Dzati Athiar
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 2023
• Subjects: Accuracy; Artificial Neural Network (ANN); Back Propagation; Cuckoo Search (CS) Algorithm; Local Minima; Mathematics; Mean Square Error (MSE); Portuguese; Slow Convergence; Accuracy; Local Minima; Slow Convergence; Cuckoo Search (CS) Algorithm; Portuguese; Mean Square Error (MSE); Back Propagation; Mathematics; Artificial Neural Network (ANN)
• ISSN: 1877-0509; 1877-0509
• DOI: 10.1016/j.procs.2023.10.458

The ANN is a commonly used network for pattern recognition, and has been trained for various tasks such as prediction, classification, and engineering. However, this model faces challenges such as local minima and slow convergence, which have been addressed through different strategies such as combining the artificial neural network (ANN) with optimised models like the cuckoo search (CS) algorithm. However, for large datasets, the hybrid ANN-based CS algorithm can lead to overfitting. To overcome this issue, the authors propose a new algorithm called Principal Component Analysis with Cuckoo Search Neural Network (PCACSNN). The performance of this algorithm is compared to other commonly used algorithms such as ANN, backpropagation neural network (BPNN), and cuckoo search backpropagation (CSBP), using the Mean Square Error (MSE) and accuracy on classification problems. The simulations were performed on the Student Performance dataset taken from the UCIMLR. The results show that the proposed model performs better than the other models, achieving high accuracy and low MSE for both mathematics and Portuguese student datasets. For the mathematics students, the suggested model attained an accuracy of (99.32%) with MSE of 2.77E-07 for 70% training data and an accuracy of 98.52% with MSE of 2.50E-04 for 30% training data. Similarly, for the Portuguese student dataset, the proposed model obtained (99.38%) accuracy with MSE of 1.09E-08 for 70% training data and 98.72% accuracy with MSE of 1.01E-04 for 30% training data.