paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Enhancing APR with PRISM: A Semantic-Based Approach to Overfitting Patch Detection

用 PRISM 增强自动程序修复:一种基于语义的过拟合补丁检测方法
OOPSLA 9(OOPSLA2)2025匹配度 2/10 · 该论文将机器学习(语义特征+定制学习算法)用于自动程序修复中的过拟合补丁检测,属于 ML 与软件工程的交叉,但既非面向 ML/Agent 系统的静态分析,也非用 LLM/Agent 改进静态分析或形式化验证,与浮点程序分析、贝叶斯程序分析也没有交集。虽然同属'机器学习与程序语言'大方向,但不在用户画像的核心问题上。引用 2 inbox
Dowon Song, Hakjoo Oh
crossref: 2026-09-10

AI 速览

一句话:提出 PRISM,用语义特征与定制学习算法检测 APR 过拟合补丁,在保留正确补丁的同时减少误报与审查负担。

自动程序修复(APR)虽进展显著,但仍常生成能通过测试却未真正修复缺陷的过拟合补丁,既降低修复效果又增加开发者审查负担。现有的自动补丁正确性分类(APCC)方法虽然整体准确,却容易将稀缺的正确补丁误判为错误,从而显著拉低 APR 的修复率。为此,作者提出 PRISM:一方面设计能捕捉补丁所引入行为变化的语义特征,另一方面设计定制学习算法,在过滤错误补丁的同时尽量保留正确补丁。实验在 10 个 APR 工具产生的排序补丁数据以及 1,829 个带标签补丁上进行评估,结果表明 PRISM 能独特地降低审查负担并找到更多正确补丁;在相同正确补丁保留率下,它能移除更多错误补丁,而其他方法常因误分类正确补丁而降低修复率。

问题
APR 工具生成的过拟合补丁能通过测试却未真正修复缺陷,而现有 APCC 方法虽准确却常将稀缺的正确补丁误判为错误,导致修复率下降。
方法
提出语义特征以刻画补丁引入的行为变化,并设计定制学习算法,在过滤错误补丁的同时优先保留正确补丁。
评估
在 10 个 APR 工具的排序补丁数据和 1,829 个带标签补丁上评估,比较审查负担、正确补丁保留率与错误补丁移除效果。
原文摘要(Abstract)

We present Prism, a novel technique for detecting overfitting patches in automatic program repair (APR). Despite significant advances in APR, overfitting patches–those passing test suites but not fixing bugs–persist, degrading performance and increasing developer review burden. To mitigate overfitting, various automatic patch correctness classification (APCC) techniques have been proposed. However, while accurate, existing APCC methods often mislabel scarce correct patches as incorrect, significantly lowering the APR fix rate. To address this, we propose (1) novel semantic features capturing patch-induced behavioral changes and (2) a tailored learning algorithm that preserves correct patches while filtering incorrect ones. Experiments on ranked patch data from 10 APR tools show that Prism uniquely reduces review burden and finds more correct patches. Other methods lower the fix rate by misclassifying correct patches. Evaluations on 1,829 labeled patches confirm Prism removes more incorrect patches at equal correct patch preservation rates.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@article{paperbot2922,
  title = {Enhancing APR with PRISM: A Semantic-Based Approach to Overfitting Patch Detection},
  author = {Dowon Song and Hakjoo Oh},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {9},
  number = {OOPSLA2},
  year = {2025},
  doi = {10.1145/3763170}
}