paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Adaptive Shielding via Parametric Safety Proofs

基于参数化安全证明的自适应屏蔽
OOPSLA 9(OOPSLA1)2025匹配度 4/10 · 论文属于 PL/形式化方法与机器学习系统安全的交叉,涉及程序验证、DSL 和概率安全保证,与 PL+ML/形式化验证方向有邻接性;但它不涉及 LLM/Agentic 程序、对 ML 代码的静态分析、浮点程序分析或贝叶斯程序分析,因此并非该研究画像的核心方向。引用 3 inbox
Yao Feng, Jun Zhu, André Platzer, Jonathan Laurent
crossref: 2026-09-10

AI 速览

一句话:提出编程语言框架,用参数化安全证明与DSL定义自适应屏蔽,为学习控制器提供概率安全保证。

学习使能控制器在环境变化时难以保证安全,现有基于模型检测与自动推理的 shielding 方法在表达力、安全性、自适应性、精度与运行时效率之间存在硬性权衡。本文提出一个编程语言框架,允许专家静态指定面向学习使能智能体的自适应屏蔽:屏蔽规约给出一个以智能体当前知识为参数的安全模型,并可通过专用领域特定语言指定非确定性推断策略,从而在运行时以统计可靠的方式推断知识参数。借助语言设计与定理证明,该框架在提供高度建模灵活性的同时,给出严格的端到端概率安全保证。摘要未报告具体实验评估。

问题
学习使能控制器在环境变化下需要运行时获取知识,但现有 shielding 方法在表达力、安全性、自适应性、精度和运行时效率间难以兼顾。
方法
提出编程语言框架,用参数化安全模型描述随知识增长而放宽的安全控制包络,并用专用 DSL 指定非确定性推断策略,结合定理证明保证知识参数被统计可靠地推断。
评估
评估以语言设计与定理证明为主,提供端到端概率安全保证;摘要未给出具体实验或基准评估。
原文摘要(Abstract)

A major challenge to deploying cyber-physical systems with learning-enabled controllers is to ensure their safety, especially in the face of changing environments that necessitate runtime knowledge acquisition. Model-checking and automated reasoning have been successfully used for shielding, i.e., to monitor un-trusted controllers and override potentially unsafe decisions, but only at the cost of hard tradeoffs in terms of expressivity, safety, adaptivity, precision and runtime efficiency. We propose a programming-language framework that allows experts to statically specify adaptive shields for learning-enabled agents, which enforce a safe control envelope that gets more permissive as knowledge is gathered at runtime. A shield specification provides a safety model that is parametric in the current agent’s knowledge. In addition, a nondeterministic inference strategy can be specified using a dedicated domain-specific language, enforcing that such knowledge parameters are inferred at runtime in a statistically-sound way. By leveraging language design and theorem proving, our proposed framework empowers experts to design adaptive shields with an unprecedented level of modeling flexibility, while providing rigorous, end-to-end probabilistic safety guarantees.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@article{paperbot3185,
  title = {Adaptive Shielding via Parametric Safety Proofs},
  author = {Yao Feng and Jun Zhu and André Platzer and Jonathan Laurent},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {9},
  number = {OOPSLA1},
  year = {2025},
  doi = {10.1145/3720450}
}