paperbot · PL 论文追踪

全部论文 待读 收藏

P1 Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents

让审判开始:一种基于LLM智能体的模拟法庭漏洞检测方法
ICSE Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering2026匹配度 6/10 · 该论文用LLM多智能体做漏洞检测,属于AI→PL中“LLM/Agent用于程序分析/安全”的范畴,并包含工业落地(零日漏洞)与较强模型验证,但与用户核心关注的静态分析/形式化验证、浮点程序分析或贝叶斯程序分析交叉点较远,方法本质是LLM智能体应用而非静态分析技术。引用 0 inbox
Ratnadira Widyasari, Martin Weyssow, Ivana Clairine Irsan, Han Wei Ang, Frank Liauw, Eng Lieh Ouh, Lwin Khin Shar, Hong Jin Kang, David Lo
crossref: 2026-09-12

AI 速览

一句话:提出模拟法庭式多智能体框架VulTrial,用角色分工与指令微调显著提升LLM漏洞检测与解释能力,并发现多个零日漏洞。

源码漏洞检测十分关键,但良性函数与漏洞函数往往高度相似,导致检测困难。本文提出VulTrial,一种受法庭审判启发的多智能体框架,用于识别漏洞代码并生成解释。该框架包含四个角色专用智能体:安全研究员、代码作者、主持人和评审委员会,并以GPT-4o作为基础LLM。实验表明,VulTrial的检测效果几乎达到此前最佳基线的两倍;使用少量数据进行角色专用指令微调可进一步显著提升效果。作者在多种LLM上验证了框架有效性,包括可本地部署的开源模型LLaMA-3.1-8B,并显示其生成的解释质量高,且能够在真实环境中发现多个已确认的零日漏洞。

问题
源码中良性函数与漏洞函数高度相似,使得自动漏洞检测仍然困难,且现有方法通常缺乏可解释性。
方法
提出VulTrial多智能体框架,设置安全研究员、代码作者、主持人和评审委员会四类角色,并以GPT-4o为基础LLM;进一步采用少量数据的角色专用指令微调提升性能。
评估
在多种LLM(包括开源可本地部署的LLaMA-3.1-8B)上开展实验,与先前最佳基线比较,并评估解释质量及在真实环境中发现零日漏洞的能力。
原文摘要(Abstract)

Detecting vulnerabilities in source code remains a critical yet challenging task, especially when benign and vulnerable functions share significant similarities. In this work, we introduce VulTrial, a courtroom-inspired multi-agent framework designed to identify vulnerable code and to provide explanations. It employs four role-specific agents, which are security researcher, code author, moderator, and review board. Using GPT-4o as the base LLM, VulTrial almost doubles the efficacy of prior best-performing baselines. Additionally, we show that role-specific instruction tuning with small quantities of data significantly further boosts VulTrial's efficacy. Our extensive experiments demonstrate the efficacy of VulTrial across different LLMs, including an open-source, in-house-deployable model (LLaMA-3.1-8B), as well as the high quality of its generated explanations and its ability to uncover multiple confirmed zero-day vulnerabilities in the wild.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot11921,
  title = {Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents},
  author = {Ratnadira Widyasari and Martin Weyssow and Ivana Clairine Irsan and Han Wei Ang and Frank Liauw and Eng Lieh Ouh and Lwin Khin Shar and Hong Jin Kang and David Lo},
  booktitle = {ICSE},
  year = {2026},
  doi = {10.1145/3744916.3773256}
}