paperbot · PL 论文追踪

全部论文 待读 收藏

P1 Evaluating Program Coverage for Code-Model Training

面向代码模型训练的程序覆盖率评估
ASE 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE)2025匹配度 5/10 · 论文处于 PL 与 CodeLLM 训练数据交叉点,用 Coverage Tree 做 COBOL 语法覆盖评估并补全缺失语句,属于程序分析服务于 ML 训练数据;但它不涉及用户核心关注的 Agentic 程序静态分析、LLM/Agent 改进静态分析/形式化验证,也与浮点或贝叶斯程序分析无关。引用 1 inbox
Nandakishore Menon, Diptikalyan Saha
crossref: 2026-09-12

AI 速览

一句话:提出 Coverage Tree 表示与工具,评估 COBOL 程序集的语法覆盖度,并自动生成语句填补未覆盖语法。

CodeLLM 已被广泛用于程序翻译(如 COBOL 转 Java、C 转 Rust),但其训练语料必须覆盖目标语言的全部语法特性,这一挑战在语法丰富而开源程序稀缺的遗留语言(如 COBOL、ABAP)上尤为突出。本文提出一个用于评估 COBOL 程序语法覆盖度的工具,其核心是一种称为 Coverage Tree 的表示,能够紧凑而直观地刻画一组程序所覆盖的语法构造。基于该表示,工具不仅能量化覆盖情况,还能针对未被覆盖的语法空缺自动生成相应的代码语句。作者在 COBOL 基准上开展实验,结果验证了该工具的有效性,并提供了演示视频。

问题
如何衡量用于 CodeLLM 训练的程序集合是否覆盖了目标语言的语法特性,尤其对 COBOL 等语法丰富但开源代码稀缺的遗留语言,训练数据往往存在语法盲区。
方法
提出紧凑直观的 Coverage Tree 表示,用于刻画一组程序所覆盖的语法构造;据此构建评估 COBOL 语法覆盖度的工具,并能针对未覆盖的语法空缺生成代码语句。
评估
在 COBOL 基准上开展实验,验证工具在评估语法覆盖度与补全语法空缺方面的有效性,并附带 screencast 演示。
原文摘要(Abstract)

In recent years, CodeLLMs have revolutionized the way developers interact with code. One notable application has been program translation, such as converting COBOL to Java or C to Rust. A critical challenge in this domain is ensuring that CodeLLMs are trained on programs that cover all syntactic features of the target language. This issue is especially pronounced for legacy languages like COBOL and ABAP, which are syntactically rich and have limited availability of open-source programs. In this paper, we present a tool for evaluating the syntactic coverage of COBOL programs. At the core of our approach is a representation called the Coverage Tree, which compactly and intuitively captures the syntactic constructs covered by a set of programs. Additionally, the tool can generate code statements to address uncovered syntactic gaps. Experimental results with COBOL benchmarks demonstrate the effectiveness of the tool. Screencast URL: https://youtu.be/lM0KHzcvllY.

链接与引用

DOI 原文 ·

BibTeX
@inproceedings{paperbot9327,
  title = {Evaluating Program Coverage for Code-Model Training},
  author = {Nandakishore Menon and Diptikalyan Saha},
  booktitle = {ASE},
  year = {2025},
  doi = {10.1109/ase63991.2025.00379}
}