paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Unsupervised Labeling and Extraction of Phrase-based Concepts in Vulnerability Descriptions

漏洞描述中基于短语概念的无监督标注与抽取
ASE 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE)2021匹配度 2/10 · 该论文研究漏洞描述文本中短语级概念的无监督标注与抽取,属于安全领域的自然语言处理任务,与用户关注的PL与AI交叉(如面向ML/Agentic程序的静态分析、LLM辅助静态分析/形式化验证、浮点程序分析、贝叶斯程序分析)几乎没有直接关联。虽然使用了VAE等无监督表示学习技术,但并非用于程序分析或LLM/Agent场景。引用 18 inbox
Sofonias Yitagesu, Zhenchang Xing, Xiaowang Zhang, Zhiyong Feng, Xiaohong Li, Linyi Han
crossref: 2026-09-12

AI 速览

一句话:提出 CaVAE 无监督标注和抽取漏洞描述中的根因、攻击向量与影响等短语概念,并优于人工标注数据。

该论文研究如何从自然语言漏洞描述中自动抽取关键漏洞概念,以减少人工标注成本。作者聚焦根因、攻击向量和影响三类基于短语的概念,因为它们比厂商、产品、版本等名称或数字实体更难标注与抽取。方法基于一个观察:同类短语即使句法结构和表达不同,也常在句法解析树中共享相似的路径。为此,论文提出绝对路径和相对路径两种表示,并用自编码器编码句法相似性;针对路径的离散性质,利用 Gumbel-Max 技巧增强传统 VAE,构建面向类别数据分布的 Categorical VAE(CaVAE)。在绝对与相对路径的隐空间中,进一步使用 FIt-TSNE 和聚类生成同类型概念簇。实验验证了 CaVAE 编码路径表示的有效性以及生成簇中漏洞概念的准确性;在概念分类任务中,无监督标注的漏洞概念优于先前工作的两个人工标注数据集。

问题
如何在不依赖大量人工标注的情况下,从自然语言漏洞描述中自动识别和抽取根因、攻击向量、影响等关键短语概念,以支持漏洞自动分析。
方法
基于同类短语在句法解析树中路径相似的观察,设计绝对路径和相对路径表示,采用 Gumbel-Max 增强的 Categorical VAE(CaVAE)编码路径,并用 FIt-TSNE 与聚类生成同类型概念簇。
评估
在漏洞描述数据上评估 CaVAE 对路径表示编码的有效性及生成簇中概念的准确性;在概念分类任务中,无监督标注概念优于先前工作的两个人工标注数据集。
原文摘要(Abstract)

People usually describe the key characteristics of software vulnerabilities in natural language mixed with domain-specific names and concepts. This textual nature poses a significant challenge for the automatic analysis of vulnerabilities. Automatic extraction of key vulnerability aspects is highly desirable but demands significant effort to manually label data for model training. In this paper, we propose an unsupervised approach to label and extract important vulnerability concepts in textural vulnerability descriptions (TVDs). We focus on three types of phrase-based vulnerability concepts (root cause, attack vector, and impact) as they are much more difficult to label and extract than name- or number-based entities (i.e., vendor, product, and version). Our approach is based on a key observation that the same-type of phrases, no matter how they differ in sentence structures and phrase expressions, usually share syntactically similar paths in the sentence parsing trees. Therefore, we propose two path representations (absolute paths and relative paths) and use an auto-encoder to encode such syntactic similarities. To address the discrete nature of our paths, we enhance traditional Variational Auto-encoder (VAE) with Gumble-Max trick for categorical data distribution, and thus creates a Categorical VAE (CaVAE). In the latent space of absolute and relative paths, we further use FIt-TSNE and clustering techniques to generate clusters of the same-type of concepts. Our evaluation confirms the effectiveness of our CaVAE for encoding path representations and the accuracy of vulnerability concepts in the resulting clusters. In a concept classification task, our unsupervisedly labeled vulnerability concepts outperform the two manually labeled datasets from previous work.

链接与引用

DOI 原文 ·

BibTeX
@inproceedings{paperbot6600,
  title = {Unsupervised Labeling and Extraction of Phrase-based Concepts in Vulnerability Descriptions},
  author = {Sofonias Yitagesu and Zhenchang Xing and Xiaowang Zhang and Zhiyong Feng and Xiaohong Li and Linyi Han},
  booktitle = {ASE},
  year = {2021},
  doi = {10.1109/ase51524.2021.9678638}
}