paperbot · PL 论文追踪

全部论文 待读 收藏

P2 AST-PAC: AST-guided Membership Inference for Code

AST-PAC:面向代码的 AST 引导成员推理
FSE Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering2026匹配度 3/10 · 该论文属于代码大模型的安全审计(成员推理攻击)方向,虽以 AST 扰动作为工具,但并非把静态分析用于改进 ML/Agentic 系统本身,也未涉及 LLM 改进静态分析、浮点或贝叶斯程序分析,研究目标仍落在 LLM/隐私审计上,与画像仅有边缘交集。引用 0 inbox
Roham Koohestani, Ali Al-Kaswan, Jonathan Katzy, Maliheh Izadi
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:提出 AST-PAC,用抽象语法树扰动生成语法合法的校准样本,改进代码大模型的成员推理审计。

代码大模型常在海量含限制性许可的源码上训练,亟需成员推理攻击(MIA)作为审计手段来检测未授权数据使用。现有 Loss Attack 提供基线,而 Polarized Augment Calibration(PAC)在代码领域尚缺乏探索。本文在 3B–7B 参数代码模型上开展探索性研究:PAC 整体优于 Loss,但其增强策略忽略代码的刚性语法,在更大、更复杂的文件上性能退化。为此作者提出 AST-PAC,通过基于抽象语法树(AST)的扰动生成语法合法的校准样本。初步结果显示,随语法规模增大 AST-PAC 提升而 PAC 下降,但 AST-PAC 对小文件扰动不足,在字母数字密集代码上表现欠佳。作者据此指出,语法感知与规模自适应的校准是代码模型来源审计可靠化的前提。

问题
代码大模型可能在含限制性许可的源码上训练,需要成员推理攻击作为审计机制来检测未授权数据使用;而现有 PAC 等方法的增强策略忽视代码的刚性语法,在大而复杂的文件上效果下降。
方法
提出 AST-PAC:在 PAC 框架下利用抽象语法树(AST)扰动生成语法合法的校准样本,使增强策略与代码语法结构对齐,并随语法规模自然扩展。
评估
在 3B–7B 参数的代码模型上,与 Loss Attack 基线和原始 PAC 进行对比的探索性实验;结果显示 AST-PAC 随语法规模增大而提升(PAC 则退化),但在小文件上扰动不足、在字母数字密集代码上表现较差。
原文摘要(Abstract)

Code Large Language Models are frequently trained on massive datasets containing restrictively licensed source code. This creates urgent data governance and copyright challenges. Membership Inference Attacks (MIAs) can serve as an auditing mechanism to detect unauthorized data usage in models. While attacks like the Loss Attack provide a baseline, more involved methods like Polarized Augment Calibration (PAC) remain underexplored in the code domain. This paper presents an exploratory study evaluating these methods on 3B-7B parameter code models. We find that while PAC generally outperforms the Loss baseline, its effectiveness relies on augmentation strategies that disregard the rigid syntax of code, leading to performance degradation on larger, complex files. To address this, we introduce AST-PAC, a domain-specific adaptation that utilizes Abstract Syntax Tree (AST) based perturbations to generate syntactically valid calibration samples. Preliminary results indicate that AST-PAC improves as syntactic size grows, where PAC degrades, but under-mutates small files and underperforms on alphanumeric-rich code. Overall, the findings motivate future work on syntax-aware and size-adaptive calibration as a prerequisite for reliable provenance auditing of code language models.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{abs-2602-13240,
  title = {AST-PAC: AST-guided Membership Inference for Code},
  author = {Roham Koohestani and Ali Al-Kaswan and Jonathan Katzy and Maliheh Izadi},
  booktitle = {FSE},
  year = {2026},
  doi = {10.1145/3803437.3805588}
}