paperbot · PL 论文追踪

全部论文 待读 收藏

P0 Guaranteed Bounds on Posterior Distributions of Discrete Probabilistic Programs with Loops

带循环的离散概率程序后验分布的保证界
POPL 9(POPL)2025匹配度 8/10 · 论文直接研究带循环离散概率程序的后验分布上下界,属于贝叶斯程序分析与概率编程形式语义的核心问题,并兼具理论保证、自动化实现与基准评估。但它不涉及 LLM 与贝叶斯程序分析的交叉,也不是浮点或 Agentic 程序静态分析。引用 11 inbox
Fabian Zaiser, Andrzej S. Murawski, C.-H. Luke Ong
crossref: 2026-09-10

AI 速览

一句话:提出残差质量语义与几何界语义,为带循环离散概率程序的后验分布自动计算保证上下界。

本文研究带循环、无界支撑且含条件化的离散概率程序后验分布界定问题。循环导致精确贝叶斯推断困难,现有方法依赖用户提供循环不变式模板。作者提出两类全自动保证界:残差质量语义基于循环剩余概率质量给出扁平界,简单高效;几何界语义引入最终几何分布(EGD)与收缩不变式,将不变式综合归约为多项式不等式约束系统,可由自动求解器判定。若存在解,则得到随循环展开指数衰减的整分布界,可界定矩与尾渐近。两种语义均具可靠性,且随循环展开收敛到精确后验;作者还研究了几何界存在的充分必要条件。最后实现工具 Diabolo,并在文献基准上验证其通用性与实用性。

问题
如何为带循环、无界支撑且含条件化的离散概率程序的后验分布提供全自动保证界;循环使精确推断困难,现有方法依赖用户提供的循环不变式模板。
方法
提出残差质量语义和几何界语义;后者基于最终几何分布(EGD)与收缩不变式,将不变式综合归约为可自动求解的多项式不等式约束系统,并证明可靠性、收敛性及几何界存在的条件。
评估
实现全自动工具 Diabolo,在文献中的多种基准上评估两种语义的通用性、所得界的质量与实用性。
原文摘要(Abstract)

We study the problem of bounding the posterior distribution of discrete probabilistic programs with unbounded support, loops, and conditioning. Loops pose the main difficulty in this setting: even if exact Bayesian inference is possible, the state of the art requires user-provided loop invariant templates. By contrast, we aim to find guaranteed bounds , which sandwich the true distribution. They are fully automated, applicable to more programs and provide more provable guarantees than approximate sampling-based inference. Since lower bounds can be obtained by unrolling loops, the main challenge is upper bounds, and we attack it in two ways. The first is called residual mass semantics , which is a flat bound based on the residual probability mass of a loop. The approach is simple, efficient, and has provable guarantees. The main novelty of our work is the second approach, called geometric bound semantics . It operates on a novel family of distributions, called eventually geometric distributions (EGDs), and can bound the distribution of loops with a new form of loop invariants called contraction invariants . The invariant synthesis problem reduces to a system of polynomial inequality constraints, which is a decidable problem with automated solvers. If a solution exists, it yields an exponentially decreasing bound on the whole distribution, and can therefore bound moments and tail asymptotics as well, not just probabilities as in the first approach. Both semantics enjoy desirable theoretical properties. In particular, we prove soundness and convergence, i.e. the bounds converge to the exact posterior as loops are unrolled further. We also investigate sufficient and necessary conditions for the existence of geometric bounds. On the practical side, we describe Diabolo , a fully-automated implementation of both semantics, and evaluate them on a variety of benchmarks from the literature, demonstrating their general applicability and the utility of the resulting bounds.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@article{ZaiserMO25,
  title = {Guaranteed Bounds on Posterior Distributions of Discrete Probabilistic Programs with Loops},
  author = {Fabian Zaiser and Andrzej S. Murawski and C.-H. Luke Ong},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {9},
  number = {POPL},
  year = {2025},
  doi = {10.1145/3704874}
}