一句话:提出RESTifAI,用LLM生成可复用、CI/CD就绪的REST API测试,覆盖正常路径与负面用例。
现有REST API测试工具多关注内部服务器错误,在可复用性、测试预言复杂度和CI/CD集成方面存在不足。本文提出RESTifAI,一种由LLM驱动的工作流,遵循happy-path方法系统构造有效测试场景,并据此派生负面用例,以验证预期功能(2xx响应)以及对非法输入或业务规则违反的鲁棒性(4xx响应)。评估表明,RESTifAI与最新LLM测试工具AutoRestTest和LogiAgent表现相当,同时改善了可复用性、预言构造和集成问题。作者提供了常见对比结果,并展示了该工具在工业服务中的适用性;工具已公开。
With this paper, we introduce RESTifAI, an LLM-driven approach for generating reusable, CI/CD-ready REST API tests, following the happy-path approach. Unlike existing tools that often focus primarily on internal server errors, RESTifAI systematically constructs valid test scenarios (happy paths) and derives negative cases to verify both intended functionality (2xx responses) and robustness against invalid inputs or business-rule violations (4xx responses). The results indicate that RESTifAI performs on par with the latest LLM tools, i.e., AutoRestTest and LogiAgent, while addressing limitations related to reusability, oracle complexity, and integration. To support this, we provide common comparative results and demonstrate the tool’s applicability in industrial services. For tool demonstration, please refer to https://www.youtube.com/watch?v=2vtQo0T0Lo4. RESTifAI is publicly available at https://github.com/casablancahotelsoftware/RESTifAI.
DOI 原文 · arXiv · PDF(开放获取) · DBLP
@inproceedings{abs-2512-08706,
title = {RESTifAI: LLM-Based Workflow for Reusable REST API Testing},
author = {Leon Kogler and Maximilian Ehrhart and Benedikt Dornauer and Eduard Paul Enoiu},
booktitle = {ICSE},
year = {2026},
doi = {10.1145/3774748.3787598}
}