paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Towards Privacy-Preserving Code Generation: Understanding and Mitigating Memorization in Code Large Language Models

迈向隐私保护代码生成:理解与缓解代码大语言模型中的记忆现象
FSE Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering2025匹配度 2/10 · 论文关注代码大语言模型训练数据记忆与隐私保护(联邦学习、差分隐私),属于代码 LLM 安全方向,但未涉及静态分析、形式化验证、Agentic 程序或浮点/贝叶斯程序分析等用户核心研究问题。引用 0 inbox
Melih Catal
crossref: 2026-09-12

AI 速览

一句话:研究代码大语言模型的训练数据记忆模式,并探索联邦学习与差分隐私以缓解隐私泄露。

代码专用大语言模型(LLM4Code)已能辅助代码生成、调试和测试,但集中式训练数据上的记忆现象会带来机密与知识产权风险,导致模型往往只能使用公开数据。该研究考察代码记忆模式,并探索联邦学习与差分隐私等隐私保护技术来缓解这些风险。目标是开发安全、高性能且包容的模型,以保护敏感信息、促进信任并推动其在软件工程中的更广泛采用。摘要未报告具体实验结果。

问题
代码大语言模型在集中式大数据集上训练时可能记忆训练数据,导致机密与知识产权泄露,因而常被迫仅使用公开数据训练。
方法
分析代码记忆模式,并探索联邦学习与差分隐私等隐私保护技术,以缓解代码大语言模型中的记忆风险。
评估
摘要未给出具体评估细节;研究目标指向在保护敏感信息的同时实现安全、高性能且包容的模型,评估预计围绕记忆分析与隐私保护技术下的隐私-性能权衡展开。
原文摘要(Abstract)

Recent advances in code-specialized language models (LLM4Code) have revolutionized software development by assisting with tasks like code generation, debugging, and testing. However, training these models on large, centralized datasets raises privacy concerns, as memorization of training data can lead to confidentiality and intellectual property risks. As a result, such models are often trained on publicly available data. This research examines code memorization patterns and explores privacy-preserving techniques, such as Federated Learning and Differential Privacy, to mitigate these risks. The goal is to develop secure, high-performance, and inclusive models that protect sensitive information, foster trust, and enable broader adoption in software engineering.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot9087,
  title = {Towards Privacy-Preserving Code Generation: Understanding and Mitigating Memorization in Code Large Language Models},
  author = {Melih Catal},
  booktitle = {FSE},
  year = {2025},
  doi = {10.1145/3696630.3731473}
}