一句话:提出 Bugs4Q,一个含 36 个经人工验证的 Qiskit 真实缺陷及其复现测试用例的量子程序调试测试基准。
量子程序的调试与测试方法缺乏可系统评估其有效性的真实缺陷基准。本文提出 Bugs4Q,从 Qiskit 的 Terra、Aer、Ignis 和 Aqua 四个常用组件中收集并人工验证了 36 个真实缺陷,为每个缺陷补充可复现错误行为的测试用例。Bugs4Q 还提供接口以访问缺陷版本与修复版本,并执行对应用例,从而支持可复现的实证研究以及 Qiskit 程序调试与测试工具之间的比较。该基准已公开托管于 GitHub,面向量子软件工程社区开放使用。
Realistic benchmarks of reproducible bugs and fixes are vital to good experimental evaluation of debugging and testing approaches. However, there is no suitable benchmark suite that can systematically evaluate the debugging and testing methods of quantum programs until now. This paper proposes Bugs4Q, a benchmark of thirty-six real, manually validated Qiskit bugs from four popular Qiskit elements (Terra, Aer, Ignis, and Aqua), supplemented with the test cases for reproducing buggy behaviors. Bugs4Q also provides interfaces for accessing the buggy and fixed versions of the Qiskit programs and executing the corresponding test cases, facilitating the reproducible empirical studies and comparisons of Qiskit program debugging and testing tools. Bugs4Q is publicly available at https://github.com/Z-928/Bugs4Q
DOI 原文 ·
@inproceedings{paperbot6541,
title = {Bugs4Q: A Benchmark of Real Bugs for Quantum Programs},
author = {Pengzhan Zhao and Jianjun Zhao and Zhongtao Miao and Shuhan Lan},
booktitle = {ASE},
year = {2021},
doi = {10.1109/ase51524.2021.9678908}
}