paperbot · PL 论文追踪

全部论文 待读 收藏

P2 A Few Pages of Markdown: Committed AI Configuration and Lower Quality Cost after Coding-Agent Adoption

几页 Markdown:提交式 AI 配置与采用编码智能体后更低的质量代价
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026匹配度 4/10 · 论文关注 Coding Agent 采纳后的仓库质量代价,并把静态分析警告作为结果指标之一,与“Agentic 程序”及工程落地有一定交集;但其核心是 AI 配置成熟度与提交行为的实证分析,并非将静态分析应用于 Agent 程序,也不是用 LLM 改进静态分析或验证。引用 0 inbox
Yegor Denisov-Blanch, Shyam Agarwal, Pavel Azaletskiy, Hao He, Rylan Schaeffer, Brando Miranda, Bogdan Vasilescu, Sanmi Koyejo
crossref: 2026-10-09

AI 速览

一句话:提出基于提交工件的四级 AI 成熟度模型 RAMP,发现编码智能体带来普遍提速,但缺少提交式 AI 配置的仓库质量代价约翻倍。

编码智能体提升开发速度,同时也带来技术债;既有研究只报告采用者的平均效应,掩盖了团队间的巨大差异。本文提出 RAMP(Repository AI Maturity Profile),一个以版本控制中提交的 AI 工具配置工件为依据的四级累积成熟度模型,涵盖行为规则与编码规范、命名智能体定义到多智能体编排,观测实践主要集中在前三级。在 441 个仓库上,各等级表现为累积量表,独立人工标注在留出样本上以 97% 的一致性复现 RAMP 的仓库级标签。采用呈累积、单向且“设置后即忘”的特点:73.8% 的工件只提交一次便不再修改。作者在既有智能体采用面板中按成熟度分层重估,发现无论成熟度高低智能体都加速开发(提交数增加 28–38%),但质量出现分化:在 agent-first 仓库中,未提交 AI 配置者认知复杂度增幅约为两倍(+53% 对 +27%),静态分析告警增加 1.7 倍。由于成熟度为观测性变量,相关工程纪律或模型能力可能部分解释该差距;作者将结论定位为假设生成性,并将 RAMP 作为可复用工具发布。

问题
编码智能体提升开发速度却可能积累技术债,而既有研究仅报告采用者的平均效应,掩盖了团队在 AI 配置实践与质量后果上的显著差异。
方法
提出 RAMP——基于版本控制中提交的 AI 配置工件构建的四级累积成熟度模型,并在 441 个仓库上验证其量表性质与人工标注一致性,再在既有智能体采用面板中按成熟度分层重估速度与质量效应。
评估
对 441 个仓库进行经验研究并检验 RAMP 标签与独立人工标注的一致性(留出样本 97%),随后在分层观测面板上分析提交数、认知复杂度与静态分析告警的变化,结果被定位为假设生成性。
原文摘要(Abstract)

Coding agents increase development velocity but also technical debt. Prior work reports only average effects across adopters, hiding wide differences between teams. We introduce RAMP (Repository AI Maturity Profile), a four-level cumulative maturity model grounded in version-controlled artifacts that teams commit to configure AI tools. RAMP runs from behavioral rules and coding standards through named agent definitions to multi-agent orchestration, with observed practice concentrated in the first three levels. Across 441 repositories the levels behave as a cumulative scale, and independent human annotation reproduces RAMP's repository-level labels on 97% of a held-out sample. Adoption is cumulative, forward-only, and set-and-forget: 73.8% of artifacts are committed once and never modified. Re-estimating an existing agent-adoption panel within each stratum, agents accelerate development regardless of maturity (28-38% more commits), but quality diverges: among agent-first repositories, where the contrast is identified, those without committed AI configuration show roughly twice the increase in cognitive complexity (+53% versus +27%) and 1.7× the increase in static-analysis warnings. Because maturity is observational, correlated engineering discipline or model capability may explain part of the gap; we present these findings as hypothesis-generating and release RAMP as a reusable instrument.

链接与引用

DOI 原文 · arXiv ·

BibTeX
@inproceedings{paperbot12321,
  title = {A Few Pages of Markdown: Committed AI Configuration and Lower Quality Cost after Coding-Agent Adoption},
  author = {Yegor Denisov-Blanch and Shyam Agarwal and Pavel Azaletskiy and Hao He and Rylan Schaeffer and Brando Miranda and Bogdan Vasilescu and Sanmi Koyejo},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3837546}
}