一句话:提出基于LLM的混合提示架构与路由算法,提升安全代码审查中安全问题识别与定位的精度和覆盖率。
安全代码审查是软件开发早期发现严重安全问题的关键环节,但现有自动化方法(静态分析、深度学习模型、提示方法)普遍存在精度低、覆盖不足、缺乏全面评估等问题。本文提出 iCodeReviewer,一种基于大语言模型的自动化安全代码审查方法。其核心是混合提示(mixture-of-prompts)架构,集成多个提示专家,每个专家是一条动态提示流水线,负责检查某一类特定安全问题,从而扩大安全问题的覆盖范围;同时设计有效的路由算法,根据输入程序的代码特征仅激活必要的提示专家,以降低LLM幻觉导致的误报。在内部数据集上的实验表明,iCodeReviewer在安全问题识别与定位上取得63.98%的F1值;在生产环境部署时,其生成的审查评论接受率高达84%。
Code review is an essential process to ensure the quality of software that identifies potential software issues at an early stage of software development. Among all software issues, security issues are the most important to identify, as they can easily lead to severe software crashes and service disruptions. Recent research efforts have been devoted to automated approaches to reduce the manual efforts required in the secure code review process. Despite the progress, current automated approaches on secure code review, including static analysis, deep learning models, and prompting approaches, still face the challenges of limited precision and coverage, and a lack of comprehensive evaluation.To mitigate these challenges, we propose iCodeReviewer, which is an automated secure code review approach based on large language models (LLMs). iCodeReviewer leverages a novel mixture-of-prompts architecture that incorporates many prompt experts to improve the coverage of security issues. Each prompt expert is a dynamic prompt pipeline to check the existence of a specific security issue. iCodeReviewer also implements an effective routing algorithm to activate only necessary prompt experts based on the code features in the input program, reducing the false positives induced by LLM hallucination. Experiment results in our internal dataset demonstrate the effectiveness of iCodeReviewer in security issue identification and localization with an F1 of 63.98%. The review comments generated by iCodeReviewer also achieve a high acceptance rate up to 84% when it is deployed in production environments.
DOI 原文 ·
@inproceedings{paperbot9356,
title = {iCodeReviewer: Improving Secure Code Review with Mixture of Prompts},
author = {Yun Peng and Kisub Kim and Linghan Meng and Kui Liu},
booktitle = {ASE},
year = {2025},
doi = {10.1109/ase63991.2025.00264}
}