PAMPAR: A new parallel benchmark for performance and energy consumption evaluation

• Published in: Concurrency and computation Vol. 32; no. 20
• Main Authors: Marques Garcia, Adriano, Schepke, Claudio, Girardi, Alessandro
• Format: Journal Article
• Language: English
• Published: Hoboken Wiley Subscription Services, Inc 25.10.2020
• Subjects: Algorithms; Benchmarks; Energy consumption; MPI; OpenMP; parallel benchmark; Parallel programming; Performance evaluation; power consumption; PThreads
• ISSN: 1532-0626; 1532-0634
• DOI: 10.1002/cpe.5504

Summary This paper presents PAMPAR, a new benchmark to evaluate the performance and energy consumption of different Parallel Programming Interfaces (PPIs). The benchmark is composed of 11 algorithms implemented in PThreads, OpenMP, MPI‐1, and MPI‐2 (spawn) PPIs. Previous studies have used some of these pseudo‐applications to perform this type of evaluation in different architectures since there is no benchmark that offers this variety of PPIs and communication models. In this work, we measure the energy and performance of each pseudo‐application in a single architecture, varying the number of threads/processes. We also organize the pseudo‐applications according to their memory accesses, floating‐point operations, and branches. The goal is to show that this set of pseudo‐applications has enough features to build a parallel benchmark. The results show that there is no single best case that provides both better performance and low energy consumption in the presented scenarios. Moreover, the pseudo‐applications usage of the system resources are different enough to represent different scenarios and be efficient as a benchmark.