paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Reinforcement Learning from Testing Targets for Effective SLM Test Generation

面向测试目标的强化学习:实现有效的 SLM 测试生成
ICSE Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering2026匹配度 3/10 · 论文属于LLM用于软件测试生成,与PL+AI有交叉,但核心是单元测试生成和强化学习优化小语言模型,并非用户关注的静态分析、形式化验证、浮点程序分析或贝叶斯程序分析。且使用SLM而非当前较强模型,与画像偏好也不一致。引用 0 inbox
Kevin Céspedes-Arancibia
crossref: 2026-09-12

AI 速览

一句话:提出 RLTT,用源自单个测试目标(如特定分支或变异体)的奖励信号优化小语言模型,生成目标导向的单元测试。

单元测试对软件可靠性至关重要,但人工编写耗时,因而催生自动化测试生成。小语言模型(SLM)比大模型更高效且隐私友好,却在覆盖率与缺陷检测上不足。已有强化学习方法依赖套件级奖励信号,聚合了所有生成测试的贡献,反馈过于粗糙,模型难以习得覆盖特定分支或杀死特定变异体等针对性行为。为此,本文提出 RLTT(Reinforcement Learning from Testing Targets):借鉴基于搜索的软件测试思想,用源自单个测试目标的奖励信号优化 SLM,并在真实应用上实证研究不同目标级奖励设计与强化学习算法如何塑造目标导向的测试行为,预期产出原则性优化框架、奖励设计准则与面向特定目标的专用 SLM。

问题
单元测试自动生成中,小语言模型(SLM)在覆盖率和故障检测上不及大模型;而已有强化学习方法使用套件级奖励信号聚合全部生成测试的贡献,反馈过于粗糙,无法指导模型学习针对具体测试目标(如特定分支、特定变异体)的行为。
方法
提出 RLTT(Reinforcement Learning from Testing Targets),借鉴基于搜索的软件测试思想,将奖励信号建立在单个测试目标而非整个测试套件之上,从而以目标驱动的方式优化 SLM,并系统考察不同目标级奖励设计与强化学习算法的影响。
评估
论文为研究计划:将在真实世界应用上进行实证评估,考察不同目标级奖励设计与强化学习算法如何影响目标导向测试行为的习得(尚未报告实验结果)。
原文摘要(Abstract)

Unit tests are essential for software reliability, yet their manual construction is time-consuming, motivating automated test generation. To support this task, Small Language Models (SLMs) have been examined as a more efficient and privacy-preserving alternative to larger models, though they often fall short in coverage and fault detection. Recent reinforcement-learning approaches address this limitation, but their effectiveness remains constrained by the use of suite-level reward signals that aggregate the contributions of all generated tests. This coarse feedback limits the model’s ability to learn targeted testing behaviors, such as exercising specific branches or killing individual mutants. To address these issues, we introduce Reinforcement Learning from Testing Targets (RLTT), a target-driven formulation in which SLMs are optimized using reward signals derived from individual testing goals, inspired by search-based software testing. We will study how different target-level reward designs and reinforcement learning algorithms shape the acquisition of goal-directed testing behaviors through an empirical evaluation on real-world applications. The expected contributions include a principled framework for optimizing models for target-driven test generation, guidelines for designing reward signals that capture partial or complete goal achievement, and specialized SLMs capable of generating effective tests for specific targets.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot11606,
  title = {Reinforcement Learning from Testing Targets for Effective SLM Test Generation},
  author = {Kevin Céspedes-Arancibia},
  booktitle = {ICSE},
  year = {2026},
  doi = {10.1145/3774748.3787638}
}