一句话:揭示代码模型会逐字记忆并输出训练代码,带来漏洞、敏感信息与许可证等安全隐私风险。
大规模数据集、先进架构和强大算力催生了可自动化多种软件工程任务的代码模型。这些数据集通常包含来自开源与私有仓库的数十亿行代码。代码模型会记忆并逐字生成源代码,而其中可能包含漏洞、敏感信息或受严格许可证约束的代码,进而引发安全与隐私问题。本文围绕代码模型的记忆现象展开,旨在揭示该现象及其潜在风险;摘要未给出具体研究方法、实验设置或定量结果。
The availability of large-scale datasets, advanced architectures, and powerful computational resources have led to effective code models that automate diverse software engineering activities. The datasets usually consist of billions of lines of code from both open-source and private repositories. A code model memorizes and produces source code verbatim, which potentially contains vulnerabilities, sensitive information, or code with strict licenses, leading to potential security and privacy issues.