paperbot · PL 论文追踪

全部论文 待读 收藏

P1 Adaptive Proof Refinement with LLM-Guided Strategy Selection

基于 LLM 引导策略选择的自适应证明精化
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026匹配度 7/10 · 论文属于 AI→PL 中利用 LLM 改进形式化验证/定理证明,与画像中的“LLM/Agent 改进形式化验证”方向契合,且以 LLM 为工具并关注强模型与基准测试。但其核心是证明精化策略选择,不涉及静态分析、浮点程序分析或贝叶斯程序分析,因此不是最核心方向。引用 5 inbox
Minghai Lu, Zhe Zhou, Danning Xie, Songlin Jia, Benjamin Delaware, Tianyi Zhang
crossref: 2026-10-09

AI 速览

一句话:提出 Adapt 框架,用 LLM 引导的决策器动态选择证明精化策略,显著提升定理证明的自动化成功率。

定理证明可实现严格的软件正确性验证,但因需要大量人工投入与专业知识而难以规模化。LLM 虽在自动生成证明上展现潜力,但首次生成的证明往往不正确,需要迭代精化;而现有方法大多采用固定的精化策略,无法根据具体情况动态选择有效策略,限制了性能。本文提出 Adapt,一个新颖的证明精化框架:它利用 LLM 引导的决策器,根据证明助手的状态以及错误证明的可用上下文,动态选择适合的精化策略。作者在两个基准套件上对比五种现有方法,Adapt 分别比最佳基线多证明 11.26% 和 18.58% 的定理;同时在六种不同 LLM 上验证了泛化性,并通过消融实验量化各组件的贡献、比较不同决策器设计的取舍。

问题
LLM 生成的证明首次尝试常出错、需要迭代精化,但现有方法使用固定的精化策略,无法依据证明状态动态选择有效策略,导致性能受限。
方法
提出 Adapt 框架,用一个 LLM 引导的决策器,根据证明助手状态与错误证明的上下文动态选择合适的精化策略。
评估
在两个基准套件上与五种现有方法对比,分别比最佳基线多证明 11.26% 和 18.58% 的定理;在六种 LLM 上评估泛化性,并通过消融实验分析各组件贡献与不同决策器设计的取舍。
原文摘要(Abstract)

Formal verification via theorem proving enables rigorous proofs of software correctness, but it is difficult to scale due to the significant manual effort and expertise required. While Large Language Models (LLMs) have shown potential in automating proof generation, they frequently produce incorrect proofs on the first attempt that require iterative refinement to fix. However, most existing approaches employ fixed refinement strategies and cannot dynamically choose an effective strategy, which limits their performance. To overcome this limitation, we introduce Adapt, a novel proof refinement framework that leverages an LLM-guided decision-maker to dynamically select a suitable refinement strategy according to the state of the proof assistant and available context of an incorrect proof. We evaluate Adapt on two benchmark suites against five existing methods and find that it significantly outperforms the best baseline on both by proving 11.26% and 18.58% more theorems, respectively. Furthermore, we demonstrate Adapt’s generalizability by evaluating it across six different LLMs. We also conduct ablation studies to measure the contribution of each component and compare the trade-offs of alternative decision-maker designs.

链接与引用

DOI 原文 · arXiv · DBLP

BibTeX
@inproceedings{abs-2510-25103,
  title = {Adaptive Proof Refinement with LLM-Guided Strategy Selection},
  author = {Minghai Lu and Zhe Zhou and Danning Xie and Songlin Jia and Benjamin Delaware and Tianyi Zhang},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3834382}
}