Load balancing for parallel loops in workstation clusters

• Published in: Proceedings of the 1996 ICPP Workshop on Challenges for Parallel Processing Vol. 3; pp. 182 - 190 vol.3
• Main Authors: Tae-Hyung Kim, Purtilo, J.M.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 1996
• Subjects: Application software; Computer science; Delay; Dynamic scheduling; Educational institutions; Impedance; Load management; Parallel processing; Processor scheduling; Workstations
• ISBN: 9780818676239; 081867623X
• ISSN: 0190-3918
• DOI: 10.1109/ICPP.1996.538574

Load imbalance is a serious impediment to achieving good performance in parallel processing. Global load balancing schemes cannot adequately manage to balance parallel tasks generated from a single application. Dynamic loop scheduling methods are known to be useful in balancing parallel loops on shared-memory multiprocessor machines. However, their centralized nature causes a bottleneck even far the relatively small number of processors in workstation clusters because of order-of-magnitude differences in communications overheads. Moreover, improvements of basic loop scheduling methods have not dealt effectively with irregularly distributed workloads in parallel loops, which commonly occur in applications for workstation clusters. In this paper, we present a new decentralized balancing method for parallel loops on workstation clusters.