Application-Oriented Performance Benchmarks for Quantum Computing

• Published in: IEEE transactions on quantum engineering Vol. 4; pp. 1 - 32
• Main Authors: Lubinski, Thomas, Johri, Sonika, Varosy, Paul, Coleman, Jeremiah, Zhao, Luning, Necaise, Jason, Baldwin, Charles H., Mayer, Karl, Proctor, Timothy
• Format: Journal Article
• Language: English
• Published: New York IEEE 2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Algorithms; application benchmarks; Benchmark testing; benchmarking; Benchmarks; Circuits; End users; Hardware; Performance evaluation; Quantum algorithm; Quantum computers; Quantum computing
• ISSN: 2689-1808; 2689-1808
• DOI: 10.1109/TQE.2023.3253761

In this work, we introduce an open-source suite of quantum application-oriented performance benchmarks that is designed to measure the effectiveness of quantum computing hardware at executing quantum applications. These benchmarks probe a quantum computer's performance on various algorithms and small applications as the problem size is varied, by mapping out the fidelity of the results as a function of circuit width and depth using the framework of volumetric benchmarking. In addition to estimating the fidelity of results generated by quantum execution, the suite is designed to benchmark certain aspects of the execution pipeline in order to provide end users with a practical measure of both the quality of and the time to solution. Our methodology is constructed to anticipate advances in quantum computing hardware that are likely to emerge in the next five years. This benchmarking suite is designed to be readily accessible to a broad audience of users and provides benchmarks that correspond to many well-known quantum computing algorithms.