Federated Reinforcement Learning-Based Dynamic Resource Allocation and Task Scheduling in Edge for IoT Applications

• Published in: Sensors (Basel, Switzerland) Vol. 25; no. 7; p. 2197
• Main Authors: Mali, Saroj, Zeng, Feng, Adhikari, Deepak, Ullah, Inam, Al-Khasawneh, Mahmoud Ahmad, Alfarraj, Osama, Alblehai, Fahad
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 30.03.2025; MDPI
• Subjects: Algorithms; Data mining; Decision making; edge computing; Energy conservation; Energy consumption; Equipment and supplies; federated learning; federated reinforcement learning; internet of things; Privacy; reinforcement learning; Resource allocation; Sensors; Simulation methods; Teaching; internet of things; edge computing; federated reinforcement learning; federated learning; reinforcement learning
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s25072197

Using Google cluster traces, the research presents a task offloading algorithm and a hybrid forecasting model that unites Bidirectional Long Short-Term Memory (BiLSTM) with Gated Recurrent Unit (GRU) layers along an attention mechanism. This model predicts resource usage for flexible task scheduling in Internet of Things (IoT) applications based on edge computing. The suggested algorithm improves task distribution to boost performance and reduce energy consumption. The system’s design includes collecting data, fusing and preparing it for use, training models, and performing simulations with EdgeSimPy. Experimental outcomes show that the method we suggest is better than those used in best-fit, first-fit, and worst-fit basic algorithms. It maintains power stability usage among edge servers while surpassing old-fashioned heuristic techniques. Moreover, we also propose the Deep Deterministic Policy Gradient (D4PG) based on a Federated Learning algorithm for adjusting the participation of dynamic user equipment (UE) according to resource availability and data distribution. This algorithm is compared to DQN, DDQN, Dueling DQN, and Dueling DDQN models using Non-IID EMNIST, IID EMNIST datasets, and with the Crop Prediction dataset. Results indicate that the proposed D4PG method achieves superior performance, with an accuracy of 92.86% on the Crop Prediction dataset, outperforming alternative models. On the Non-IID EMNIST dataset, the proposed approach achieves an F1-score of 0.9192, demonstrating better efficiency and fairness in model updates while preserving privacy. Similarly, on the IID EMNIST dataset, the proposed D4PG model attains an F1-score of 0.82 and an accuracy of 82%, surpassing other Reinforcement Learning-based approaches. Additionally, for edge server power consumption, the hybrid offloading algorithm reduces fluctuations compared to existing methods, ensuring more stable energy usage across edge nodes. This corroborates that the proposed method can preserve privacy by handling issues related to fairness in model updates and improving efficiency better than state-of-the-art alternatives.