一句话:在 20 个真实项目中实证评估 LLM 助手以人机混合工作流生成安全需求与 STRIDE 威胁模型的效果。
大型组织中安全需求与威胁模型的人工编写工作量大且易出现不一致与覆盖缺口,而生成式 AI 因信任、数据隐私与领域特异性问题在受监管环境中采纳有限。本文在受控、可审计条件下实证评估基于 LLM 的辅助工具,采用人机混合流程,由专家评审并验证 AI 生成产物以保障上下文准确性与合规性。工具以业务文档为输入生成候选安全需求与基于 STRIDE 的威胁模型。在巴西某公共机构 20 个真实项目中比较纯 AI、纯人工与混合三种流程,结果显示产物生成时间平均减少 18.3%,STRIDE 威胁覆盖率提升 13.6%,语义精确率为 73%,混合流程在完整性与整体质量上持续优于纯人工流程。
The manual generation of software development artifacts in large organizations—particularly security requirements and threat models—demands substantial effort and is prone to inconsistencies and coverage gaps. While recent advances in generative AI show promise for supporting Requirements Engineering, their adoption in security-critical and regulated environments remains limited due to concerns related to trust, data privacy, and domain specificity. This paper presents an empirical evaluation of an LLM-based AI assistant designed to support security requirements engineering and threat modeling under controlled and auditable conditions. The proposed approach adopts a human-AI hybrid workflow, in which AI-generated artifacts are systematically reviewed and validated by specialists to preserve contextual accuracy and regulatory compliance. Using business documents as input, the assistant generates candidate security requirements and STRIDE-based threat models. The study compares AI-only, manual, and hybrid workflows across 20 real-world projects conducted in a Brazilian public organization. Results show an average reduction of 18.3% in artifact generation time and a 13.6% increase in STRIDE threat coverage, while maintaining 73% semantic precision. Furthermore, the hybrid human-AI approach consistently outperformed the fully manual process in terms of completeness and overall quality. These findings provide empirical evidence that generative AI can effectively support security requirements engineering when embedded within human-centered workflows and organizational governance structures, offering practical insights for adoption in regulated software development contexts.