一句话:挖掘 Stack Overflow 安全讨论,用 LLM 抽取代码示例与解释以自动丰富安全编码实践。
安全编码实践(SCP)通常只有一句话原则,缺乏具体说明,开发者难以落地。SCPatcher 通过挖掘 Stack Overflow 等在线知识共享平台中的众包安全讨论来自动丰富 SCP。对每个安全帖子,先用 Prompt Learning 调优的 LLM 抽取代码示例区与代码解释区;再将长代码分层切分为代码示例,并借助区域信息总结解释;最后匹配 CWE 与公共 SCP,融合示例和解释生成带细节的“野生 SCP 规范”。在 3907 个安全帖上,其代码示例抽取平均比基线高 2.73% MLine,解释抽取高 3.97% F1;在 447 个新帖上,生成规范为公共 SCP 增加 3074 行代码和 1967 句说明。
Secure coding practices (SCPs) have been proposed to guide software developers to write code securely to prevent potential security vulnerabilities. Yet, they are typically one-sentence principles without detailed specifications, e.g., “Properly free allocated memory upon the completion of functions and at all exit points.”, which makes them difficult to follow in practice, especially for software developers who are not yet experienced in secure programming. To address this problem, this paper proposes SCPatcher, an automated approach to enrich secure coding practices by mining crowd security discussions on online knowledge-sharing platforms, such as Stack Overflow. In particular, for each security post, SCPatcher first extracts the area of coding examples and coding explanations with a fix-prompt tuned Large Language Model (LLM) via Prompt Learning. Then, it hierarchically slices the lengthy code into coding examples and summarizes the coding explanations with the areas. Finally, SCPatcher matches the CWE and Public SCP, integrating them with extracted coding examples and explanations to form the SCP specifications, which are the wild SCPs with details, proposed by the developers. To evaluate the performance of SCPatcher, we conduct experiments on 3,907 security posts from Stack Overflow. The experimental results show that SCPatcher outperforms all baselines in extracting the coding examples with 2.73 % MLine on average, as well as coding explanations with 3.97 % F1 on average. Moreover, we apply SCPatcher on 447 new security posts to further evaluate its practicality, and the extracted SCP specifications enrich the public SCPs with 3,074 lines of code and 1,967 sentences.