paperbot · PL 论文追踪

全部论文 待读 收藏

P2 LLM-Enabled Open-Source Systems in the Wild: An Empirical Study of Vulnerabilities in GitHub Security Advisories

真实世界中的 LLM 赋能开源系统:GitHub 安全公告漏洞实证研究
FSE Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering2026匹配度 3/10 · 论文是LLM相关开源系统的安全漏洞实证研究,与LLM/Agentic程序的安全风险有间接关联;但它不涉及静态分析、形式化验证、浮点程序分析或贝叶斯程序分析,也非用LLM/Agent改进PL,因此与用户核心研究方向匹配度较低。引用 1 inbox
Fariha Tanjim Shifat, Hariswar Baburaj, Ce Zhou, Jaydeb Sarker, Mia Mohammad Imran
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:实证分析295份LLM相关GitHub安全公告,发现传统CWE覆盖实现缺陷但低估模型介导风险,需结合OWASP LLM Top 10。

问题:LLM日益嵌入开源软件,传统漏洞披露框架是否充分捕捉模型介导风险尚不清楚。方法:分析2025年1月至2026年1月间引用LLM组件的295份GitHub安全公告,并依据OWASP LLM应用Top 10 2025人工标注其中100份。结果:未发现LLM系统特有的新实现级弱点类别,多数公告映射到既有CWE,尤其是注入与反序列化;OWASP视角揭示供应链、过度代理、提示注入等架构风险模式,且常跨执行阶段共现。结论:现有公告元数据能捕捉代码缺陷,但低估模型介导暴露;结合CWE与OWASP可获得更完整、必要的漏洞视图。

问题
随着LLM嵌入开源软件生态,自然语言提示、概率输出与可执行组件交互带来新风险,但传统漏洞披露框架能否充分刻画这些模型介导风险仍不明确。
方法
分析295份2025年1月至2026年1月引用LLM组件的GitHub Security Advisories,并用OWASP Top 10 for LLM Applications 2025人工标注100份样本。
评估
通过CWE映射与OWASP标注对比,发现多数漏洞仍属既有实现级CWE(注入、反序列化),但OWASP揭示供应链、过度代理、提示注入等架构风险,表明需结合两类视角。
原文摘要(Abstract)

Large language models (LLMs) are increasingly embedded in open-source software (OSS) ecosystems, creating complex interactions among natural language prompts, probabilistic model outputs, and execution-capable components. However, it remains unclear whether traditional vulnerability disclosure frameworks adequately capture these model-mediated risks. To investigate this, we analyze 295 GitHub Security Advisories published between January 2025 and January 2026 that reference LLM-related components, and we manually annotate a sample of 100 advisories using the OWASP Top 10 for LLM Applications 2025. We find no evidence of new implementation-level weakness classes specific to LLM systems. Most advisories map to established CWEs, particularly injection and deserialization weaknesses. At the same time, the OWASP-based analysis reveals recurring architectural risk patterns, especially Supply Chain, Excessive Agency, and Prompt Injection, which often co-occur across multiple stages of execution. These results suggest that existing advisory metadata captures code-level defects but underrepresents model-mediated exposure. We conclude that combining the CWE and OWASP perspectives provides a more complete and necessary view of vulnerabilities in LLM-integrated systems.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{abs-2604-04288,
  title = {LLM-Enabled Open-Source Systems in the Wild: An Empirical Study of Vulnerabilities in GitHub Security Advisories},
  author = {Fariha Tanjim Shifat and Hariswar Baburaj and Ce Zhou and Jaydeb Sarker and Mia Mohammad Imran},
  booktitle = {FSE},
  year = {2026},
  doi = {10.1145/3803437.3805532}
}