paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Debugging the Debuggers: Failure-Anchored Structured Recovery for Software Engineering Agents

调试调试器:面向软件工程智能体的失败锚定结构化恢复
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026匹配度 4/10 · 论文针对软件工程智能体的失败恢复,属于 Agentic 程序范畴,与用户关注的 Agentic 程序有领域重叠;但方法基于运行时遥测而非静态分析,也未涉及 LLM 用于静态分析/形式化验证、浮点或贝叶斯程序分析,且研究目标偏向提升智能体自身能力,与用户核心方向匹配度有限。其工业落地与问题驱动视角有一定参考价值,但整体相关性不强。引用 5 inbox
Chenyu Zhao, Shenglin Zhang, Yihang Lin, Wenwei Gu, Zhimin Chen, Yongqian Sun, Dan Pei, Chetan Bansal, Saravan Rajmohan, Minghua Ma
crossref: 2026-10-09

AI 速览

一句话:提出 PROBE,将失败运行遥测转为结构化诊断与有界恢复指导,提升软件工程智能体的失败后恢复能力。

软件工程智能体失败后的恢复仍昂贵、人工且临时。现有系统只暴露轨迹或生成反馈,未将异构运行时证据转化为有依据、有边界的恢复指导。本文提出 PROBE,一个失败锚定的结构化恢复框架,含遥测层、诊断层与指导门:保留细粒度运行时信号,融合跨信号证据形成有依据诊断,并仅在证据充分、可操作且限于智能体行为范围时生成恢复指导。在仓库级软件修复、企业工作流恢复与 AIOps 服务缓解的 257 个未解决案例上,PROBE 达到 65.37% Top-1 诊断准确率与 21.79% 恢复率,分别超最强基线 43.58 和 12.45 个百分点;微软 IcM 原型表明其可作为非侵入式旁路接入现有诊断流程。

问题
软件工程智能体在可评估工程环境中失败后,恢复过程仍昂贵、人工且临时,现有系统未能把异构运行时证据转化为有依据、有边界的恢复指导。
方法
提出 PROBE,由遥测层、诊断层和指导门组成,将失败运行遥测组织为结构化证据、结构化诊断和有界恢复指导。
评估
在仓库级软件修复、企业工作流恢复和 AIOps 服务缓解三类场景的 257 个初始未解决案例上评估,并展示微软 IcM 非侵入式原型接入。
原文摘要(Abstract)

Software engineering agents are increasingly deployed in evaluable engineering environments, yet post-failure recovery remains costly, manual, and largely ad hoc. Existing systems expose traces for inspection or generate follow-up feedback, but they do not turn heterogeneous runtime evidence into grounded, bounded recovery guidance for a subsequent attempt. We present PROBE, a failure-anchored framework for structured recovery in software engineering agents. PROBE organizes failed-run telemetry into structured evidence, structured diagnosis, and bounded recovery guidance, realized by a Telemetry Layer, a Diagnosis Layer, and a Guidance Gate. The Telemetry Layer preserves fine-grained runtime signals, the Diagnosis Layer fuses cross-signal evidence into a grounded diagnosis, and the Guidance Gate constructs diagnosis-derived recovery guidance only when it is evidence-grounded, actionable, and within the scope of agent-side behavior. We evaluate PROBE across three software engineering settings spanning repository-level software repair, enterprise workflow recovery, and AIOps service mitigation. On 257 initially unresolved cases, PROBE achieves 65.37% Top-1 diagnosis accuracy and a 21.79% recovery rate, outperforming the strongest non-PROBE baseline by 43.58 and 12.45 percentage points, respectively. The results reveal a substantial diagnosis-recovery gap: accurate diagnosis is necessary but not sufficient unless it can be translated into bounded guidance that the subsequent attempt can execute and verify. Beyond controlled evaluation, a Microsoft IcM prototype shows that PROBE can attach as a non-intrusive side channel to existing service-diagnosis agent workflows without changing the agent policy, toolset, or execution budget. These results suggest that telemetry-grounded, failure-anchored recovery is a practical path to improving post-failure recoverability of software engineering agents under realistic engineering constraints.

链接与引用

DOI 原文 · arXiv · DBLP

BibTeX
@inproceedings{abs-2605-08717,
  title = {Debugging the Debuggers: Failure-Anchored Structured Recovery for Software Engineering Agents},
  author = {Chenyu Zhao and Shenglin Zhang and Yihang Lin and Wenwei Gu and Zhimin Chen and Yongqian Sun and Dan Pei and Chetan Bansal and Saravan Rajmohan and Minghua Ma},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3834492}
}