paperbot · PL 论文追踪

全部论文 待读 收藏

P2 An Empirical Evaluation of Generative AI in Security Requirements Engineering and Threat Modeling

生成式 AI 在安全需求工程与威胁建模中的实证评估
FSE Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering2026匹配度 2/10 · 该论文将 LLM 用于安全需求工程与 STRIDE 威胁建模,属于软件工程/安全工程的人机协作实证评估,不涉及用户核心关注的静态分析、形式化验证、浮点程序分析或贝叶斯程序分析。虽然使用了 LLM 并包含工业落地评估,但与 PL 与 AI 交叉的核心问题匹配度很低。引用 0 inbox
Francis Martins, Elaine Venson
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:在 20 个真实项目中实证评估 LLM 助手以人机混合工作流生成安全需求与 STRIDE 威胁模型的效果。

大型组织中安全需求与威胁模型的人工编写工作量大且易出现不一致与覆盖缺口,而生成式 AI 因信任、数据隐私与领域特异性问题在受监管环境中采纳有限。本文在受控、可审计条件下实证评估基于 LLM 的辅助工具,采用人机混合流程,由专家评审并验证 AI 生成产物以保障上下文准确性与合规性。工具以业务文档为输入生成候选安全需求与基于 STRIDE 的威胁模型。在巴西某公共机构 20 个真实项目中比较纯 AI、纯人工与混合三种流程,结果显示产物生成时间平均减少 18.3%,STRIDE 威胁覆盖率提升 13.6%,语义精确率为 73%,混合流程在完整性与整体质量上持续优于纯人工流程。

问题
大型组织中安全需求与威胁模型的手工编写耗费大量精力,且容易出现不一致与覆盖缺口;在安全关键与受监管场景下,生成式 AI 因信任、隐私与领域特异性问题难以被采纳。
方法
提出并实证评估一个基于 LLM 的 AI 助手,采用人机混合工作流:以业务文档为输入生成候选安全需求与 STRIDE 威胁模型,再由专家系统评审与验证以保证上下文准确性和合规性。
评估
在巴西某公共组织的 20 个真实项目中,对纯 AI、纯人工与混合三种工作流进行对比。结果显示生成时间平均减少 18.3%、STRIDE 威胁覆盖率提升 13.6%、语义精确率保持 73%,混合流程在完整性与整体质量上稳定优于纯人工流程。
原文摘要(Abstract)

The manual generation of software development artifacts in large organizations—particularly security requirements and threat models—demands substantial effort and is prone to inconsistencies and coverage gaps. While recent advances in generative AI show promise for supporting Requirements Engineering, their adoption in security-critical and regulated environments remains limited due to concerns related to trust, data privacy, and domain specificity. This paper presents an empirical evaluation of an LLM-based AI assistant designed to support security requirements engineering and threat modeling under controlled and auditable conditions. The proposed approach adopts a human-AI hybrid workflow, in which AI-generated artifacts are systematically reviewed and validated by specialists to preserve contextual accuracy and regulatory compliance. Using business documents as input, the assistant generates candidate security requirements and STRIDE-based threat models. The study compares AI-only, manual, and hybrid workflows across 20 real-world projects conducted in a Brazilian public organization. Results show an average reduction of 18.3% in artifact generation time and a 13.6% increase in STRIDE threat coverage, while maintaining 73% semantic precision. Furthermore, the hybrid human-AI approach consistently outperformed the fully manual process in terms of completeness and overall quality. These findings provide empirical evidence that generative AI can effectively support security requirements engineering when embedded within human-centered workflows and organizational governance structures, offering practical insights for adoption in regulated software development contexts.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{MartinsV26,
  title = {An Empirical Evaluation of Generative AI in Security Requirements Engineering and Threat Modeling},
  author = {Francis Martins and Elaine Venson},
  booktitle = {FSE},
  year = {2026},
  doi = {10.1145/3803437.3805203}
}