paperbot · PL 论文追踪

全部论文 待读 收藏

P2 More with Less: An Empirical Study of Turn-Control Strategies for Efficient Coding Agents

以少胜多:高效编码智能体轮次控制策略的实证研究
ICSE Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering2026匹配度 4/10 · 论文研究编码 Agent 的轮次控制策略以平衡成本与解决率,属于 Agentic 程序运行效率的实证研究,与用户关注的 Agentic 程序场景有边缘关联;但未涉及静态分析、形式化验证或浮点/贝叶斯程序分析,且研究目标偏向 LLM/Agent 本身的成本优化,与用户核心方向(PL 与 AI 交叉中的静态分析)匹配度有限。引用 10 inbox
Pengfei Gao, Chao Peng
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:首次系统实证三种轮次控制策略,提出按需延长的动态轮次策略,在保持解决率的同时大幅降低成本。

LLM 驱动的编码智能体通过多轮(turn)迭代完成软件工程任务,但 token 随轮次近似二次增长、顶尖模型价格高昂、真实任务所需轮次多、且智能体常有低效动作,导致部署成本高且不可预测。已有研究多关注单轮优化,而总轮数的策略性控制尚缺乏探索。本文在 SWE-bench 上使用 Claude 4 Sonnet、Gemini 2.5 Pro 与 GPT 4.1 三种先进模型,系统比较三种策略:无限制基线、带提醒的固定轮次上限、以及按需授予延长的动态轮次策略。结果显示:无限制设置下性能、成本与轮次效率之间存在根本性权衡,没有单一模型全面占优;固定上限取基线第 75 百分位是“甜点”,可降低成本 24%–68% 而对解决率影响很小;动态策略持续优于固定上限,在解决率相当或更好的情况下再额外降本 12%–24%,因为它只把资源分配给真正需要的任务。该工作给出了简单易行的成本—效果平衡指南。

问题
LLM 编码智能体在真实软件工程任务中成本高昂且不可预测,而如何从总轮数层面进行策略性控制以平衡性能与开销,此前缺乏系统研究。
方法
在 SWE-bench 基准上用 Claude 4 Sonnet、Gemini 2.5 Pro、GPT 4.1 三种模型,对比无限制基线、带提醒的固定轮次上限(含不同分位点)与按需延长的动态轮次策略。
评估
以解决率、token/金钱成本与轮次效率为指标进行大规模实证对比,量化各策略的降本幅度及其对解决率的影响,并检验动态策略相对固定上限的增益。
原文摘要(Abstract)

LLM-powered coding agents, which operate in iterative loops (turns) to solve software engineering tasks, are becoming increasingly powerful. However, their practical deployment is hindered by significant and unpredictable costs. This challenge arises from a combination of factors: quadratically growing token counts with each turn, the high price of state-of-the-art models, the large number of turns required for real-world tasks, and the tendency of agents to take inefficient or unnecessary actions. While existing research focuses on optimizing individual turns, the strategic control of the total number of turns remains an underexplored area for managing agent performance and cost. To address this gap, we conduct a comprehensive empirical study on the SWE-bench benchmark using three state-of-the-art models (Claude 4 Sonnet, Gemini 2.5 Pro, and GPT 4.1). We systematically evaluate the impact of three distinct turn-control strategies: an unrestricted baseline, a fixed-turn limit with reminders, and a novel dynamic-turn strategy that grants extensions on-demand. Our findings first reveal a fundamental trade-off in the unrestricted setting, where no single model excels across performance, cost, and turn efficiency. We then show that a fixed-turn limit, specifically at the 75th percentile of the baseline, serves as a "sweet spot", substantially reducing costs (by 24%-68%) with minimal impact on solve rates. Most significantly, our proposed dynamic-turn strategy consistently outperforms fixed-limit approaches, achieving comparable or better solve rates while further reducing costs by an additional 12%-24% by intelligently allocating resources only to tasks that need them. This work provides the first systematic analysis of turn-control strategies, offering simple yet effective guidelines for developers to balance cost and efficacy. We demonstrate that dynamic resource allocation is a superior, easy-to-implement approach for deploying powerful yet economically viable coding agents.

链接与引用

DOI 原文 · arXiv · DBLP

BibTeX
@inproceedings{abs-2510-16786,
  title = {More with Less: An Empirical Study of Turn-Control Strategies for Efficient Coding Agents},
  author = {Pengfei Gao and Chao Peng},
  booktitle = {ICSE},
  year = {2026},
  doi = {10.1145/3744916.3773250}
}