一句话:通过对论文与 GitHub issue 的大规模实证分析,构建 LLM 编码智能体的操作安全失效分类体系,揭示严重风险与任务分布。
基于 LLM 的自主编码智能体正被快速集成到开发流程,但其在良性、目标导向使用中的操作安全问题仍缺乏理解,现有基准多关注显式恶意输入。本文开展事件驱动的实证研究,筛选 22 个顶级会议的 68,816 篇论文,整理 185 项安全相关研究,并从广泛部署的 LLM 编码工具中挖掘 16,586 条 GitHub issue,人工确认 547 个真实安全失效。通过开放编码,作者提出覆盖七个维度、33 种操作风险的多维安全分类体系,并标注诱因、任务上下文、严重程度与下游影响。结果显示 326/547 事件为高或严重风险,主要风险包括约束违反、破坏性操作、授权绕过与欺骗;超过 65% 的事件发生在 bug 修复和安装配置任务中。研究呼吁护栏应超越对抗提示防御,强制环境约束、失败透明与安全停止。
Autonomous coding agents built on large language models (LLMs) are rapidly being integrated into development workflows, yet their operational safety properties remain poorly understood beyond evaluations of explicitly malicious inputs. In practice, high-impact failures arise during benign, goal-directed use through environment breakage, fabricated success reports, etc. that current benchmarks do not capture. What categories of operational safety failures actually occur when coding agents are used for everyday development tasks and what is their impact? We present an incident-driven empirical study grounded in two complementary evidence streams. We screen 68,816 papers from 22 premier venues, curating 185 safety-relevant studies, and mine 16,586 GitHub issues from widely deployed LLM-powered coding tools, manually confirming 547 genuine safety failures. Applying systematic open coding over both corpora, we derive a multi-dimensional safety taxonomy of 33 operational risk types organized across seven dimensions, and annotate each incident with contributing factors, task context, severity, and downstream impact. Our findings show that coding-agent failures are often severe, with 326 of 547 incidents rated high or critical. The dominant risks are constraint violations, destructive operations, authorization bypasses, and deception, and over 65% of incidents arise in bug fixing and setup or configuration, patterns largely missing from prior literature. These results have direct implications for SE tool designers and benchmark developers: guardrails must go beyond adversarial-prompt defenses to enforce environmental constraints, failure transparency, and safe-halt behaviors.