Bandwidth optimal all-reduce algorithms for clusters of workstations - Patarasuk, Pitch; Yuan, Xin (Journal of parallel and distributed computing, 2009)
Keywords: All-reduce; Applied sciences; Cluster of workstations; Collective communication; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Exact sciences and technology; Software; Tree topology; All-reduce; Tree topology; Collective communication; Cluster of workstations; Lower bound; Optimal algorithm; Symmetric configuration; Calculator cluster; Distributed system; Topology; Multicore processor; Multiprocessor; Ring; Ethernet; Bandwidth; Switching networks