paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Understanding neural code intelligence through program simplification

通过程序简化理解神经代码智能
FSE Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering2021匹配度 4/10 · 该论文属于神经代码智能模型的可解释性研究,通过程序简化识别模型依赖的输入特征,与用户核心关注的“静态分析×LLM/Agent”“LLM/Agent 改进程序分析”以及浮点/贝叶斯程序分析交叉方向距离较远;虽然涉及程序分析与模型的结合,但目标不是面向 ML 系统或 Agentic 程序的静态分析,也未聚焦当前 LLM/Agent 场景。引用 38 inbox
Md Rafiqul Islam Rabin, Vincent J. Hellendoorn, Mohammad Amin Alipour
crossref: 2026-09-12

AI 速览

一句话:提出模型无关的 SIVAND,用程序简化识别神经代码智能模型的关键输入特征。

神经代码智能工具由深度神经网络驱动,已广泛用于提升编程生产力和程序分析,但开发者难以可靠理解其行为。现有透明/可解释AI方法常针对特定网络架构,甚至需要访问模型参数,普通程序员难以使用。本文提出 SIVAND,一种简单、模型无关的方法,借鉴软件调试中的 delta debugging,通过简化输入程序并在保持模型预测不变的前提下,识别对预测关键的特征。实验表明,该方法输出显著更小的程序,可广泛适用于多种模型架构和问题领域;模型常仅依赖输入程序中少数句法特征。作者认为,SIVAND 提取的特征有助于理解神经代码智能系统的预测与学习行为。

问题
深度神经网络驱动的代码智能工具难以解释,现有可解释方法常局限于特定架构或需访问模型参数,普通开发者难以采用。
方法
SIVAND 借鉴 delta debugging,对输入程序进行保持模型预测不变的简化,以模型无关方式提取关键输入特征。
评估
在多种模型架构和问题领域上评估,发现简化输出显著更小,且模型往往仅依赖少数句法特征。
原文摘要(Abstract)

A wide range of code intelligence (CI) tools, powered by deep neural networks, have been developed recently to improve programming productivity and perform program analysis. To reliably use such tools, developers often need to reason about the behavior of the underlying models and the factors that affect them. This is especially challenging for tools backed by deep neural networks. Various methods have tried to reduce this opacity in the vein of "transparent/interpretable-AI". However, these approaches are often specific to a particular set of network architectures, even requiring access to the network's parameters. This makes them difficult to use for the average programmer, which hinders the reliable adoption of neural CI systems. In this paper, we propose a simple, model-agnostic approach to identify critical input features for models in CI systems, by drawing on software debugging research, specifically delta debugging. Our approach, SIVAND, uses simplification techniques that reduce the size of input programs of a CI model while preserving the predictions of the model. We show that this approach yields remarkably small outputs and is broadly applicable across many model architectures and problem domains. We find that the models in our experiments often rely heavily on just a few syntactic features in input programs. We believe that SIVAND's extracted features may help understand neural CI systems' predictions and learned behavior.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot6415,
  title = {Understanding neural code intelligence through program simplification},
  author = {Md Rafiqul Islam Rabin and Vincent J. Hellendoorn and Mohammad Amin Alipour},
  booktitle = {FSE},
  year = {2021},
  doi = {10.1145/3468264.3468539}
}