paperbot · PL 论文追踪

全部论文 待读 收藏

P1 Formal verification of higher-order probabilistic programs: reasoning about approximation, convergence, Bayesian inference, and optimization

高阶概率程序的形式验证:关于近似、收敛、贝叶斯推断与优化的推理
POPL 3(POPL)2019匹配度 6/10 · 该论文属于概率程序的形式化验证,直接覆盖用户画像中的“贝叶斯程序分析”与“形式化验证”方向,并涉及高阶/连续分布概率语言;但它不涉及 LLM/Agent、静态分析在 ML 系统或 Agentic 程序中的应用,也非浮点程序分析或 LLM 与程序分析的交叉。引用 28 inbox
Tetsuya Sato, Alejandro Aguirre, Gilles Barthe, Marco Gaboardi, Deepak Garg, Justin Hsu
crossref: 2026-09-10

AI 速览

一句话:提出 PPV 逻辑族,用于验证带连续分布和高阶函数概率程序的近似、收敛、贝叶斯推断与优化性质。

概率编程语言常结合连续分布、条件化与高阶函数,表达力强但给程序语义与验证带来根本挑战,已有工作多聚焦基础语义。本文提出逻辑族 PPV,用于证明这类高阶概率程序的属性,支持对近似、收敛、贝叶斯推断和优化的推理。PPV 通过精心选取概率论结果的公理,模拟非形式证明的推理风格;其可靠性基于 quasi-Borel spaces(QBS)解释程序与断言。作者还给出已有逻辑的可靠嵌入,并以参数化方式将一元与关系型 ⊤⊤-lifting 的语义思想内化到逻辑中。最后,通过对统计学、概率推断和机器学习中的多个复杂例子进行形式验证,展示其实用性与表达力。

问题
表达力强的高阶概率程序(含连续采样、条件化、高阶函数)难以进行程序语义与属性验证,已有工作主要关注基础语义问题。
方法
提出逻辑族 PPV,采用概率论公理进行证明,并以 quasi-Borel spaces 给出程序与断言的可靠性解释,同时嵌入既有逻辑和内化 ⊤⊤-lifting。
评估
通过对统计学、概率推断和机器学习中的复杂例子进行形式验证,并给出逻辑嵌入的可靠性结果来评估表达力。
原文摘要(Abstract)

Probabilistic programming provides a convenient lingua franca for writing succinct and rigorous descriptions of probabilistic models and inference tasks. Several probabilistic programming languages, including Anglican, Church or Hakaru, derive their expressiveness from a powerful combination of continuous distributions, conditioning, and higher-order functions. Although very important for practical applications, these features raise fundamental challenges for program semantics and verification. Several recent works offer promising answers to these challenges, but their primary focus is on foundational semantics issues. In this paper, we take a step further by developing a suite of logics, collectively named PPV for proving properties of programs written in an expressive probabilistic higher-order language with continuous sampling operations and primitives for conditioning distributions. Our logics mimic the comfortable reasoning style of informal proofs using carefully selected axiomatizations of key results from probability theory. The versatility of our logics is illustrated through the formal verification of several intricate examples from statistics, probabilistic inference, and machine learning. We further show expressiveness by giving sound embeddings of existing logics. In particular, we do this in a parametric way by showing how the semantics idea of (unary and relational) ⊤⊤-lifting can be internalized in our logics. The soundness of PPV follows by interpreting programs and assertions in quasi-Borel spaces (QBS), a recently proposed variant of Borel spaces with a good structure for interpreting higher order probabilistic programs.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@article{paperbot681,
  title = {Formal verification of higher-order probabilistic programs: reasoning about approximation, convergence, Bayesian inference, and optimization},
  author = {Tetsuya Sato and Alejandro Aguirre and Gilles Barthe and Marco Gaboardi and Deepak Garg and Justin Hsu},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {3},
  number = {POPL},
  year = {2019},
  doi = {10.1145/3290351}
}