paperbot · PL 论文追踪

全部论文 待读 收藏

P2 RESTifAI: LLM-Based Workflow for Reusable REST API Testing

RESTifAI:基于LLM的可复用REST API测试工作流
ICSE Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering2026匹配度 3/10 · 该论文属于 LLM 驱动的软件测试方向(REST API 测试生成),与用户的四个核心方向(面向 ML/Agentic 程序的静态分析、LLM 辅助静态分析/形式化验证、浮点程序分析、贝叶斯程序分析)均无直接交集,既不做程序分析也不涉及形式化。仅在'LLM 作为工程工具'与'工业落地案例'这两点边缘偏好上有所契合。引用 4 inbox
Leon Kogler, Maximilian Ehrhart, Benedikt Dornauer, Eduard Paul Enoiu
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:提出RESTifAI,用LLM生成可复用、CI/CD就绪的REST API测试,覆盖正常路径与负面用例。

现有REST API测试工具多关注内部服务器错误,在可复用性、测试预言复杂度和CI/CD集成方面存在不足。本文提出RESTifAI,一种由LLM驱动的工作流,遵循happy-path方法系统构造有效测试场景,并据此派生负面用例,以验证预期功能(2xx响应)以及对非法输入或业务规则违反的鲁棒性(4xx响应)。评估表明,RESTifAI与最新LLM测试工具AutoRestTest和LogiAgent表现相当,同时改善了可复用性、预言构造和集成问题。作者提供了常见对比结果,并展示了该工具在工业服务中的适用性;工具已公开。

问题
现有REST API测试工具主要针对内部服务器错误,且存在测试难以复用、预言复杂、CI/CD集成困难等问题。
方法
RESTifAI采用LLM驱动的工作流,先系统构造有效的happy-path测试场景,再派生负面用例,验证2xx功能响应与4xx鲁棒性响应。
评估
与AutoRestTest和LogiAgent等最新LLM测试工具进行对比,结果显示性能相当,并通过工业服务案例展示适用性。
原文摘要(Abstract)

With this paper, we introduce RESTifAI, an LLM-driven approach for generating reusable, CI/CD-ready REST API tests, following the happy-path approach. Unlike existing tools that often focus primarily on internal server errors, RESTifAI systematically constructs valid test scenarios (happy paths) and derives negative cases to verify both intended functionality (2xx responses) and robustness against invalid inputs or business-rule violations (4xx responses). The results indicate that RESTifAI performs on par with the latest LLM tools, i.e., AutoRestTest and LogiAgent, while addressing limitations related to reusability, oracle complexity, and integration. To support this, we provide common comparative results and demonstrate the tool’s applicability in industrial services. For tool demonstration, please refer to https://www.youtube.com/watch?v=2vtQo0T0Lo4. RESTifAI is publicly available at https://github.com/casablancahotelsoftware/RESTifAI.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{abs-2512-08706,
  title = {RESTifAI: LLM-Based Workflow for Reusable REST API Testing},
  author = {Leon Kogler and Maximilian Ehrhart and Benedikt Dornauer and Eduard Paul Enoiu},
  booktitle = {ICSE},
  year = {2026},
  doi = {10.1145/3774748.3787598}
}