paperbot · PL 论文追踪

全部论文 待读 收藏

P1 Property Inference for Deep Neural Networks

深度神经网络的属性推断
ASE 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE)2019匹配度 5/10 · 论文关注神经网络形式化属性推断与验证,属于将程序分析/形式化方法应用于机器学习系统的方向,与用户的PL→AI兴趣部分相关;但它不涉及Agentic/LLM程序、浮点程序分析或贝叶斯程序分析,也不是LLM辅助静态分析,因此不落在核心研究问题上。引用 6 inbox
Divya Gopinath, Hayes Converse, Corina Pasareanu, Ankur Taly
crossref: 2026-09-12

AI 速览

一句话:提出自动推断前馈神经网络形式化属性的技术,从神经元激活模式中提取蕴含期望输出性质的输入与层属性。

针对神经网络缺乏可理解形式化属性这一问题,论文观察到前馈网络的逻辑在很大程度上体现于神经元激活状态(开或关),因而提出从神经元决策中提取模式作为前提条件,用以蕴含期望的输出性质(如预测为某一类别)。作者给出两类技术:一是提取输入属性,即输入空间上蕴含给定输出属性的凸谓词;二是提取层属性,即隐藏层中捕获的、蕴含期望输出行为的网络性质。方法在面向 MNIST 与 ACASXU 应用的网络上进行了评估,实验表明所推断的属性可用于多种任务,包括解释预测、提供鲁棒性保证、简化证明以及网络蒸馏。

问题
神经网络是黑盒,其内部逻辑难以用形式化属性刻画,从而阻碍了可解释性、鲁棒性保证与验证。
方法
基于前馈网络逻辑主要体现为神经元激活状态这一观察,从神经元决策中提取模式,自动推断输入空间上的凸谓词(输入属性)和隐藏层性质(层属性),使其蕴含期望的输出属性。
评估
在 MNIST 与 ACASXU 的网络实例上应用该技术,并展示所推断属性在解释预测、提供鲁棒性保证、简化证明与网络蒸馏等任务中的用途。
原文摘要(Abstract)

We present techniques for automatically inferring formal properties of feed-forward neural networks. We observe that a significant part (if not all) of the logic of feed forward networks is captured in the activation status (on or off) of its neurons. We propose to extract patterns based on neuron decisions as preconditions that imply certain desirable output property e.g., the prediction being a certain class. We present techniques to extract input properties, encoding convex predicates on the input space that imply given output properties and layer properties, representing network properties captured in the hidden layers that imply the desired output behavior. We apply our techniques on networks for the MNIST and ACASXU applications. Our experiments highlight the use of the inferred properties in a variety of tasks, such as explaining predictions, providing robustness guarantees, simplifying proofs, and network distillation.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot5295,
  title = {Property Inference for Deep Neural Networks},
  author = {Divya Gopinath and Hayes Converse and Corina Pasareanu and Ankur Taly},
  booktitle = {ASE},
  year = {2019},
  doi = {10.1109/ase.2019.00079}
}