paperbot · PL 论文追踪

全部论文 待读 收藏

P1 A Minimalist Proof Language for Neural Theorem Proving over Isabelle/HOL

面向 Isabelle/HOL 神经定理证明的极简证明语言
OOPSLA 10(OOPSLA1)2026匹配度 7/10 · 论文属于 LLM/Agent 改进形式化验证中的神经定理证明,与用户“AI→PL”方向直接相关;但其核心是 Isabelle/HOL 证明语言 Minilang 设计与微调,不涉及静态分析、浮点程序分析或贝叶斯程序分析,属于邻近方向。引用 0 inbox
Qiyuan Xu, Renxi Wang, Peixin Wang, Haonan Li, Conrad Watt
crossref: 2026-09-10

AI 速览

一句话:提出极简证明语言 Minilang,并翻译 Isar 语料微调 LLM,以提升 Isabelle/HOL 神经定理证明性能。

神经定理证明(NTP)用 LLM 自动构造 Isabelle/HOL 等形式证明,但形式证明语言包含大量专用语法与策略,与非形式数学证明差异显著,给 LLM 带来额外负担。本文从语言设计出发,归纳非形式证明与机器证明中的常见推理模式,提出极简证明语言 Minilang(Isabelle/Minilang),核心仅 10 个语义清晰的证明操作,并实现从 Isar 到 Minilang 的规则翻译器,以约 85% 成功率翻译约 34 万条 Isabelle 证明。基于该语料微调两个 LLM 后,实验表明 Minilang 相比原始 Isar 有/无 Sledgehammer 将 PISA 上 pass@1 最多提升 20/29 个百分点,达 69.1%,超过 Baldur 的 pass@64(65.7%);pass@8 达 79.2%,超过 Magnushammer 的 71.0%。

问题
形式证明语言中大量专用语法和策略与自然语言非形式证明差异大,给基于 LLM 的神经定理证明带来额外负担。
方法
从语言设计出发设计仅含 10 个语义清晰操作的极简证明语言 Minilang,并实现从 Isar 到 Minilang 的规则翻译器,用翻译语料微调两个 LLM。
评估
翻译约 34 万条 Isabelle 证明(约 85% 成功率),在 PISA 基准上比较微调 LLM 在 Minilang 与 Isar 上的 pass@k;Minilang 使 pass@1 最多提升 20/29 个百分点,达 69.1%,pass@8 达 79.2%。
原文摘要(Abstract)

Neural Theorem Proving (NTP) employs Large Language Models (LLMs) to automate formal proofs in proof assistants. While LLMs have achieved relatively remarkable success in informal reasoning tasks using natural languages, the transition to mechanized formal theorem proving presents persistent challenges. Mechanized proof languages often contain many syntactic constructs and diverse, specialized proof tactics, which facilitate expert use but have no direct counterpart in informal mathematical proofs. These prover-specific idioms represent an additional burden for LLM-based NTPs that might be otherwise successful in generating informal proofs. Seeking to bridge this gap between formal proof construction and informal reasoning, in order to better facilitate NTP, this work approaches these challenges from a language design perspective. We look at common reasoning patterns in informal proofs and in existing mechanized proofs, and design Minilang (formally named Isabelle/Minilang), a minimalist proof language that captures these reasoning patterns. In contrast to proof languages (informal and formal) that often feature a large collection of operations with unclear semantic boundaries, Minilang is deliberately kept minimalist – its core design comprises only 10 proof operations, each with clear semantic distinctions. We further develop a rule-based translator from Isabelle’s proof language (Isar) to Minilang, translating ∼340,000 existing Isabelle proofs with an ∼85% success rate. Using this translated corpus, we finetune two LLMs to compare machine learning performance on Minilang versus the original Isar language. Experiments show Minilang benefits the two LLMs by improving the pass@1 success rate on the PISA benchmark by up to 20/29 percentage points in comparison to the Isar-based LLMs w/wo Sledgehammer. The pass@1 rate reaches 69.1%, exceeding the prior work Baldur’s pass@64 (65.7%); the pass@8 rate reaches 79.2%, exceeding the state-of-the-art on PISA (71.0%) achieved by Magnushammer.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@article{paperbot3833,
  title = {A Minimalist Proof Language for Neural Theorem Proving over Isabelle/HOL},
  author = {Qiyuan Xu and Renxi Wang and Peixin Wang and Haonan Li and Conrad Watt},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {10},
  number = {OOPSLA1},
  year = {2026},
  doi = {10.1145/3798275}
}