paperbot · PL 论文追踪

全部论文 待读 收藏

P1 An abstract domain for certifying neural networks

用于神经网络认证的抽象域
POPL 3(POPL)2019匹配度 7/10 · 该论文属于 PL→AI 方向,将抽象解释静态分析应用于神经网络(机器学习系统)的认证,并涉及浮点多面体与区间抽象域,兼具理论形式化与工程实现。但未涉及 LLM/Agentic 程序,也非传统浮点程序分析或贝叶斯程序分析,与当前核心关注的 LLM 交叉方向有距离。引用 621 inbox
Gagandeep Singh, Timon Gehr, Markus Püschel, Martin Vechev
crossref: 2026-09-10

AI 速览

一句话:提出结合浮点多面体与区间的抽象域 DeepPoly,实现对深度神经网络可扩展且精确的认证。

该论文研究深度神经网络的可扩展、精确认证问题。其核心贡献是提出一种新的抽象域,将浮点多面体与区间相结合,并针对神经网络场景定制抽象变换器,具体包括仿射变换、ReLU、sigmoid、tanh 与 maxpool 的变换器。作者在名为 DeepPoly 的系统中实现了该方法,并在多个数据集、网络架构(含防御网络)和规范上进行了广泛评估。实验表明,DeepPoly 比先前工作更精确,同时能扩展到大型网络。论文还展示了如何将 DeepPoly 与基于 trace partitioning 的抽象精化相结合,从而首次证明网络在输入图像经受旋转等采用线性插值的复杂扰动时仍具有鲁棒性。

问题
如何为深度神经网络提供既精确又可扩展的认证方法,并在复杂输入扰动下证明其鲁棒性。
方法
提出一种结合浮点多面体与区间的抽象域,并为仿射变换、ReLU、sigmoid、tanh、maxpool 设计专用抽象变换器;在 DeepPoly 中实现,并引入基于 trace partitioning 的抽象精化。
评估
在多个数据集、神经网络架构(包括防御网络)和规范上广泛评估 DeepPoly,与先前工作比较精度与可扩展性,并验证其在旋转等复杂扰动下的鲁棒性证明能力。
原文摘要(Abstract)

We present a novel method for scalable and precise certification of deep neural networks. The key technical insight behind our approach is a new abstract domain which combines floating point polyhedra with intervals and is equipped with abstract transformers specifically tailored to the setting of neural networks. Concretely, we introduce new transformers for affine transforms, the rectified linear unit (ReLU), sigmoid, tanh, and maxpool functions. We implemented our method in a system called DeepPoly and evaluated it extensively on a range of datasets, neural architectures (including defended networks), and specifications. Our experimental results indicate that DeepPoly is more precise than prior work while scaling to large networks. We also show how to combine DeepPoly with a form of abstraction refinement based on trace partitioning. This enables us to prove, for the first time, the robustness of the network when the input image is subjected to complex perturbations such as rotations that employ linear interpolation.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@article{paperbot646,
  title = {An abstract domain for certifying neural networks},
  author = {Gagandeep Singh and Timon Gehr and Markus Püschel and Martin Vechev},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {3},
  number = {POPL},
  year = {2019},
  doi = {10.1145/3290354}
}