一句话:提出SAINT,用静态分析构建端点模型与操作依赖图,并借助LLM智能体自动生成企业Java服务级测试。
企业应用需服务级测试,但现有RESTful API工具多依赖模糊测试或OpenAPI规范,真实代码库常缺少规范,且难以生成有意义的功能场景测试。SAINT是面向企业Java应用的白盒方法,结合静态分析、LLM与智能体,构建端点模型和操作依赖图,刻画端点语义与跨端点顺序约束。智能体据此生成端点级测试以最大化代码和数据库交互覆盖,并从代码提取用例,经规划、行动、反思循环精化为场景测试。在八个Java应用(含专有企业应用)上评估,SAINT在覆盖率、故障检测与场景生成上有效,开发者调研认可其场景测试。
Enterprise applications are typically tested at multiple levels, with service-level testing playing an important role in validating application functionality. Existing service-level testing tools, especially for RESTful APIs, often employ fuzzing and/or depend on OpenAPI specifications which are not readily available in real-world enterprise codebases. Moreover, these tools are limited in their ability to generate functional tests that effectively exercise meaningful scenarios. In this work, we present saint, a novel white-box testing approach for service-level testing of enterprise Java applications. saint combines static analysis, large language models (LLMs), and LLM-based agents to automatically generate endpoint and scenario-based tests. The approach builds two key models: an endpoint model, capturing syntactic and semantic information about service endpoints, and an operation dependency graph, capturing inter-endpoint ordering constraints. saint then employs LLM-based agents to generate tests. Endpoint-focused tests aim to maximize code and database interaction coverage. Scenario-based tests are synthesized by extracting application use cases from code and refining them into executable tests via planning, action, and reflection phases of the agentic loop. We evaluated saint on eight Java applications, including a proprietary enterprise application. Our results illustrate the effectiveness of saint in coverage, fault detection, and scenario generation. Moreover, a developer survey provides strong endorsement of the scenario-based tests generated by saint. Overall, our work shows that combining static analysis with agentic LLM workflows enables more effective, functional, and developer-aligned service-level test generation.
@inproceedings{abs-2511-13305,
title = {SAINT: Service-level Integration Test Generation with Program Analysis and LLM-based Agents},
author = {Rangeet Pan and Raju Pavuluri and Ruikai Huang and Tyler Stennett and Rahul Krishna and Alessandro Orso and Saurabh Sinha},
booktitle = {ICSE},
year = {2026},
doi = {10.1145/3744916.3773185}
}