paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Testing Programs Expecting Highly Constrained Inputs

测试期望高度约束输入的程序
ICSE Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering2026匹配度 3/10 · 该论文属于软件测试与输入生成方向,关注受约束输入的程序测试充分性,与用户核心关注的 LLM/Agent×静态分析、浮点程序分析及贝叶斯程序分析交叉较少;仅在广义程序分析/PL领域有边缘关联。引用 0 inbox
Valentin Huber
crossref: 2026-09-12

AI 速览

一句话:提出输入正确性与有趣性度量,并探索生成既正确又有趣的输入以测试输入校验后的程序逻辑。

当前测试生成器产出的输入受限,导致程序测试不均衡,尤其面对期望高度结构化输入的程序时,大量代码未获充分测试。本文提出两种度量以评估不同测试生成方法并定位未被充分测试的程序部分:输入正确性衡量输入满足期望结构的程度,可对照实现或规约判断;输入有趣性衡量输入到等价类边界的距离。基于对 clang 的初步评估,作者给出输入正确性分布,表明以生成结构合法输入为目标的方法难以测试输入校验步骤之后的程序逻辑。最后提出三种方法,试图生成既正确又有趣的输入,以弥补这一缺口。

问题
测试生成器难以产生高度结构化输入,导致程序测试不均衡,特别是输入校验步骤之后的逻辑无法被充分覆盖。
方法
提出输入正确性和输入有趣性两类度量,分别评估输入满足预期结构的程度以及与等价类边界的距离,并据此比较不同测试生成方法。
评估
在 clang 上进行初步评估,展示输入正确性分布,论证结构合法输入生成方法的局限,并据此提出三种生成既正确又有趣输入的方法。
原文摘要(Abstract)

Current test generators are limited in the inputs they produce. This leads to an imbalance in the program parts tested, with significant program parts receiving insufficient attention, particularly with programs expecting inputs that are highly structured. In this work, I propose two measurements to evaluate different approaches and find which parts of programs are under-tested. Input correctness provides a level to which an input satisfies the expected structure, measured either against an implementation or specification. Input interestingness checks the distance to equivalence class boundaries. I present the distribution of input correctness from an initial evaluation on a clang, indicating that approaches designed to provide structurally valid inputs are unable to test program logic behind the input validation steps. I finally propose three approaches to closing this gap by producing inputs that are both correct and interesting.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot11798,
  title = {Testing Programs Expecting Highly Constrained Inputs},
  author = {Valentin Huber},
  booktitle = {ICSE},
  year = {2026},
  doi = {10.1145/3774748.3787671}
}