HyperX topology, routing, and packaging of efficient large-scale networks

• Published in: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis pp. 1 - 11
• Main Authors: Ahn, Jung Ho, Binkert, Nathan, Davis, Al, McLaren, Moray, Schreiber, Robert S.
• Format: Conference Proceeding
• Language: English
• Published: New York, NY, USA ACM 14.11.2009
• Series: ACM Conferences
• Subjects: Bandwidth; Costs; General and reference > Cross-computing tools and techniques > Performance; Hypercubes; Network topology; Networks > Network properties > Network structure; Networks > Network protocols > Network layer protocols > Routing protocols; Networks > Network services > Network management; Optical interconnections; Optical switches; Packaging; Routing; Sockets; Topology
• ISBN: 1605587443; 9781605587448
• ISSN: 2167-4329
• DOI: 10.1145/1654059.1654101

In the push to achieve exascale performance, systems will grow to over 100,000 sockets, as growing cores-per-socket and improved single-core performance provide only part of the speedup needed. These systems will need affordable interconnect structures that scale to this level. To meet the need, we consider an extension of the hypercube and flattened butterfly topologies, the HyperX, and give an adaptive routing algorithm, DAL. HyperX takes advantage of high-radix switch components that integrated photonics will make available. Our main contributions include a formal descriptive framework, enabling a search method that finds optimal HyperX configurations; DAL; and a low cost packaging strategy for an exascale HyperX. Simulations show that HyperX can provide performance as good as a folded Clos, with fewer switches. We also describe a HyperX packaging scheme that reduces system cost. Our analysis of efficiency, performance, and packaging demonstrates that the HyperX is a strong competitor for exascale networks.