paperbot · PL 论文追踪

全部论文 待读 收藏

P2 LazyHMC: Hamiltonian Monte Carlo Simulation for Lazy, Infinite Dimensional Probabilistic Programs

LazyHMC:面向惰性、无限维概率程序的 Hamiltonian Monte Carlo 模拟
ICFP 10(ICFP)2026匹配度 4/10 · 论文属于概率编程语言与贝叶斯推断方向,其中的 PACAP 分析也与静态分析/形式化方法有交叉,因此与“贝叶斯程序分析”有一定方法层面的关联;但它不涉及 LLM/Agent、浮点程序分析,也不是面向 ML 系统或 Agentic 程序的静态分析,和当前画像的核心问题距离较远。引用 0 inbox
Maria-Nicoleta Crăciun, C.-H. Luke Ong, Tom Schrijvers, Sam Staton
crossref: 2026-09-10

AI 速览

一句话:提出在惰性函数式概率程序中实现无限维参数空间上的梯度型 HMC 与 NUTS,并用 PACAP 分析保证梯度有限支撑。

该论文针对标准 HMC 依赖梯度和有限维参数空间的问题,利用 Haskell 惰性求值表达随机过程等隐式无限维非参数贝叶斯模型。作者提出 LazyHMC,为无限维设置给出基于惰性求值的梯度型 HMC 新表述。针对自动微分,引入“柱状解析划分下的分段解析”(PACAP)分析,证明即使程序无限维且惰性定义,似然梯度仍具有有限支撑。蒙特卡洛方面,开发多种 HMC 变体与 No-U-Turn Sampler,使其可在无限维参数空间运行,并因惰性求值保持可产出。实验包括高斯混合聚类、随机游走,以及带 Poisson 过程变点的分段常值回归。

问题
标准 HMC 需要梯度与有限维参数空间,难以直接用于 Haskell 惰性概率程序所表达的无限维非参数贝叶斯模型。
方法
通过惰性求值构造无限维梯度型 HMC 新表述,引入 PACAP 分析自动微分,并开发多种 HMC 变体与无限维 NUTS。
评估
在高斯混合聚类、随机游走和带 Poisson 过程变点的分段常值回归上开展实验。
原文摘要(Abstract)

Hamiltonian Monte Carlo (HMC) is a successful generic inference method in probabilistic programming, but in its ordinary formulation it needs gradients and finite-dimensional parameter spaces. In Haskell, lazy evaluation lets probabilistic programs express stochastic processes and other non-parametric Bayesian models over implicit infinite-dimensional spaces. This paper develops new formulations of gradient-based HMC for this infinite-dimensional setting, via lazy evaluation. For automatic differentiation, we provide an analysis based on a new notion of "piecewise analytic under cylindrical analytic partition" (PACAP), to show that even if a program is infinite-dimensional and defined lazily, the gradient of the likelihood function is finitely supported. For the Monte Carlo method itself, we develop several HMC variants and a No-U-Turn Sampler that operate over the infinite-dimensional parameter space but are still productive because of lazy evaluation. Experiments cover Gaussian mixture clustering, random walks, and piecewise-constant regression with Poisson-process changepoints.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@article{CraciunOSS26,
  title = {LazyHMC: Hamiltonian Monte Carlo Simulation for Lazy, Infinite Dimensional Probabilistic Programs},
  author = {Maria-Nicoleta Crăciun and C.-H. Luke Ong and Tom Schrijvers and Sam Staton},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {10},
  number = {ICFP},
  year = {2026},
  doi = {10.1145/3828696}
}