EUVIMEDSkopri EUVIMED
Crossref

QASMBench: A Low-Level Quantum Benchmark Suite for NISQ Evaluation and Simulation

Ang Li, Samuel Stein, Sriram Krishnamoorthy, James Ang

ACM Transactions on Quantum Computing · 2023-06-30 · 4 (2) · 1-26

DOI: 10.1145/3550488 ↗

At a glance

Journal article in ACM Transactions on Quantum Computing, published online on 2023-02-24. Written by Ang Li and 3 co-authors. Cited 183 times so far (Crossref); 136 references. Funded by: U.S. Department of Energy, Office of Science, National Quantum Information Science Research Centers, Co-design Center for Quantum Advantage, DOE Office of Science User Facility, Pacific Northwest National Laboratory is operated by Battelle for the U.S. Department of Energy.

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

The rapid development of quantum computing (QC) in the NISQ era urgently demands a low-level benchmark suite and insightful evaluation metrics for characterizing the properties of prototype NISQ devices, the efficiency of QC programming compilers, schedulers and assemblers, and the capability of quantum system simulators in a classical computer. In this work, we fill this gap by proposing a low-level, easy-to-use benchmark suite called QASMBench based on the OpenQASM assembly representation. It consolidates commonly used quantum routines and kernels from a variety of domains including chemistry, simulation, linear algebra, searching, optimization, arithmetic, machine learning, fault tolerance, cryptography, and so on, trading-off between generality and usability. To analyze these kernels in terms of NISQ device execution, in addition to circuit width and depth, we propose four circuit metrics including gate density, retention lifespan, measurement density, and entanglement variance, to extract more insights about the execution efficiency, the susceptibility to NISQ error, and the potential gain from machine-specific optimizations. Applications in QASMBench can be launched and verified on several NISQ platforms, including IBM-Q, Rigetti, IonQ and Quantinuum. For evaluation, we measure the execution fidelity of a subset of QASMBench applications on 12 IBM-Q machines through density matrix state tomography, comprising 25K circuit evaluations. We also compare the fidelity of executions among the IBM-Q machines, the IonQ QPU and the Rigetti Aspen M-1 system. QASMBench is released at: http://github.com/pnnl/QASMBench .

Funding

  • U.S. Department of Energy, Office of Science, National Quantum Information Science Research Centers, Co-design Center for Quantum Advantage
  • DOE Office of Science User Facility
  • Pacific Northwest National Laboratory is operated by Battelle for the U.S. Department of Energy

Cite

APA

Li, A., Stein, S., Krishnamoorthy, S., & Ang, J. (2023). QASMBench: A Low-Level Quantum Benchmark Suite for NISQ Evaluation and Simulation. ACM Transactions on Quantum Computing, 4(2), 1-26. https://doi.org/10.1145/3550488

Vancouver

Li A, Stein S, Krishnamoorthy S, Ang J. QASMBench: A Low-Level Quantum Benchmark Suite for NISQ Evaluation and Simulation. ACM Transactions on Quantum Computing. 2023;4(2):1-26. doi:10.1145/3550488

BibTeX
@article{Li2023,
  author = {Li, Ang and Stein, Samuel and Krishnamoorthy, Sriram and Ang, James},
  title = {QASMBench: A Low-Level Quantum Benchmark Suite for NISQ Evaluation and Simulation},
  journal = {ACM Transactions on Quantum Computing},
  year = {2023},
  volume = {4},
  number = {2},
  pages = {1--26},
  doi = {10.1145/3550488}
}
Start for free →