一句话：提出 BenGQL，一个包含 23 个开源 GraphQL 服务器案例的可扩展基准框架，用于统一评估和比较自动化测试工具。
GraphQL API 因高效的数据获取策略而日益流行，其软件性质要求进行功能与非功能测试。已有负载测试器、模糊测试器等自动化测试工具，但缺少共同的案例集，难以严格评估和比较这些工具。为此，本文提出 BenGQL，一个包含 23 个代表性开源 GraphQL 服务器应用的基准测试框架，覆盖不同的底层引擎和模式复杂度。BenGQL 提供可扩展基础设施，使开发者和研究者能够在相同案例上运行测试工具，使用自定义分析模块分析和比较结果，并通过新案例、工具或指标扩展基准。其目标是促进更严谨、可复现的 GraphQL 自动化测试研究，并已开源代码和提供视频演示。
GraphQL APIs provide a unified endpoint for retrieving and uploading data in a web application. Due to its efficient data-fetching strategy, which allows for the retrieval of only the required data, GraphQL is gaining popularity. Its software nature necessitates robust testing, both functional and non-functional. As automated testing tools, including load testers and fuzzers, are developed to assess GraphQL APIs, they lack a common set of case studies for rigorous evaluation and comparison.To address this gap, we present BenGQL, a benchmarking framework containing 23 representative open-source GraphQL server applications, spanning different underlying engines and schema complexities. BenGQL provides an extensible infrastructure for running testing tools against these case studies, enabling developers and researchers to: (i) execute testing tools against the same case studies, (ii) analyse and compare results using custom analysis modules, and (iii) extend the benchmark with new case studies, tools, or metrics.The ultimate goal of BenGQL is to foster more rigorous, reproducible research in automated GraphQL testing by providing both the case studies and the infrastructure for running experiments. As a consequence, we release the source code at https://github.com/marcellomaugeri/BenGQL, inviting other researchers to contribute. A video demonstration is also available at https://youtu.be/wZ06Xxa_Koo.
DOI 原文 ·
@inproceedings{paperbot9444,
title = {BenGQL: An Extensible Benchmarking Framework for Automated GraphQL Testing},
author = {Abenezer Angamo and Marcello Maugeri},
booktitle = {ASE},
year = {2025},
doi = {10.1109/ase63991.2025.00376}
}