A Improved Consistent Hash Algorithm in Heterogeneous Edge Computing

• Published in: Proceedings - International Conference on Parallel and Distributed Systems pp. 2353 - 2360
• Main Authors: Chai, Ruonan, Gao, Shuai, Hu, Zhenghao
• Format: Conference Proceeding
• Language: English
• Published: IEEE 17.12.2023
• Subjects: Delays; Heterogeneous edge computing; Large scale; Load balancing; Load management; Matching accuracy of computing resources; Processor scheduling; Resource management; Scalability; Servers; System performance
• ISSN: 2690-5965
• DOI: 10.1109/ICPADS60453.2023.00315

Load balancing plays a critical role in large-scale heterogeneous edge computing, aiming to enhance the accuracy of computing resource matching and reduce processing delays caused by imbalanced resource allocation. In highly heterogeneous distributed computing environments, scalability and accuracy in matching computing resources are essential. The Consistent Hashing (CH) algorithm is well-known for its simplicity and strong scalability, enabling extensive and flexible scheduling strategies. It achieves load balancing by evenly distributing requests among different nodes. However, the CH algorithm primarily focuses on load balancing in storage resource scenarios and often neglects load balancing for computing resources, potentially leading to reduced accuracy in matching computing resources and prolonged processing delays. This paper introduces an improved CH algorithm called chordDC, specifically designed for distributed computing scenarios. It takes into account the unified representation of user tasks and computing resources, incorporating additional discriminative criteria in the selection of computing nodes to achieve a more precise resource allocation. Through a comparative analysis with two baseline algorithms, the proposed algorithm demonstrates effective performance improvements, enhancing the accuracy of computing resource matching by 40%-50% and significantly reducing computing processing latency.