paperbot · PL 论文追踪

全部论文 待读 收藏

P2 BASHIRI: Learning Failure Oracles from Execution Features

BASHIRI:从执行特征中学习失败预言(oracle)
ASE 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE)2025匹配度 3/10 · 该论文属于用机器学习辅助软件工程(从执行特征学习测试预言),方向上是 AI→PL 的泛化相邻工作,但既非静态分析/形式化验证,也不涉及 LLM/Agent,与用户核心关注的静态分析、浮点分析与贝叶斯程序分析没有直接交集。引用 0 inbox
Marius Smytzek, Martin Eberlein, Tural Mammadov, Lars Grunske, Andreas Zeller
crossref: 2026-09-12

AI 速览

一句话:提出 BASHIRI 工具,利用执行特征训练可解释模型作为测试预言,以 95% 准确率判定测试通过/失败。

程序修复必须保持原有通过测试继续通过,同时使失败测试转为通过,验证这些性质需要能够区分通过与失败运行的测试预言(test oracle)。本文提出 BASHIRI,一种从带标签结果的测试套件中学习失败预言的工具:它借助执行特征驱动的调试(execution-feature-driven debugging)收集程序执行特征,并在此基础上训练可解释模型作为测试预言。评估表明,BASHIRI 能以 95% 的准确率预测测试结果,有效识别失败运行。BASHIRI 已作为开源工具发布,并提供演示视频。

问题
程序修复的验证需要测试预言来区分程序运行的通过与失败,但此类预言往往缺失或需要人工编写。
方法
利用执行特征驱动的调试收集程序执行特征,并在带标签测试结果上训练可解释机器学习模型作为测试预言。
评估
在带标签结果的测试套件上评估,BASHIRI 预测测试结果的准确率达到 95%,能有效识别失败运行。
原文摘要(Abstract)

Program fixes must preserve passing tests while fixing failing ones. Validating these properties requires test oracles that distinguish passing from failing runs.We introduce BASHIRI, a tool that learns failure oracles from test suites with labeled outcomes using execution features. BASHIRI leverages execution-feature-driven debugging to collect program execution features and trains interpretable models as testing oracles. Our evaluation shows that BASHIRI predicts test outcomes with 95% accuracy, effectively identifying failing runs. BASHIRI is available as an open-source tool at https://github.com/smythi93/bashiriA demonstration video is available at https://youtu.be/D2mJkCtSXtM

链接与引用

DOI 原文 ·

BibTeX
@inproceedings{paperbot9256,
  title = {BASHIRI: Learning Failure Oracles from Execution Features},
  author = {Marius Smytzek and Martin Eberlein and Tural Mammadov and Lars Grunske and Andreas Zeller},
  booktitle = {ASE},
  year = {2025},
  doi = {10.1109/ase63991.2025.00372}
}