Optimizing Kubernetes Scheduling for Web Applications Using Machine Learning

• Published in: Electronics (Basel) Vol. 14; no. 5; p. 863
• Main Authors: Dakić, Vedran, Đambić, Goran, Slovinac, Jurica, Redžepagić, Jasmin
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.03.2025
• Subjects: Algorithms; Applications programs; Automation; Edge computing; Efficiency; Energy efficiency; Forecasts and trends; Internet software; Machine learning; Neural networks; Optimization; Scheduling; Web applications; Workloads
• ISSN: 2079-9292; 2079-9292
• DOI: 10.3390/electronics14050863

Machine learning (ML) has significantly enhanced computing and optimization, offering solutions to complex challenges. This paper investigates the development of a custom Kubernetes scheduler employing ML to optimize web application placement. A cluster of five nodes was established for evaluation, utilizing Python and TensorFlow to create and train a neural network that forecasts scheduling times for various configurations. The dataset, generated via scripts, encompassed multiple scenarios to ensure thorough model training. The results indicate that the custom scheduler with ML consistently surpasses the default Kubernetes scheduler in scheduling time by 1–18%, depending on the scenario. As expected, the difference between the built-in and ML-based scheduler becomes more evident with higher loads, underscoring opportunities for future research by using other ML algorithms and considering energy efficiency.