paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Unified Software Engineering Agent as AI Software Engineer

统一的软件工程智能体作为 AI 软件工程师
ICSE Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering2026匹配度 4/10 · 论文聚焦构建统一的软件工程 LLM Agent 与跨任务基准,属于 coding agent 的构建与评测;与用户关注的“对 agentic 程序做静态分析”“用 LLM/Agent 改进静态分析/形式化验证”以及浮点/贝叶斯程序分析均无直接交集,只能作为 agentic coding 背景参考。引用 19 inbox
Leonhard Applis, Yuntong Zhang, Shanchao Liang, Nan Jiang, Lin Tan, Abhik Roychoudhury
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:提出统一软件工程智能体 USEagent 与 USEbench 基准,使 LLM 智能体跨编码、测试与修复等多任务协同。

软件工程不止于编码,还涉及项目的维护与演化,但已有 LLM 智能体多为测试、调试、修复等单一任务定制。本文提出统一软件工程智能体 USEagent:以 LLM 为推理引擎自主调用外部工具,统一编排编码、测试、补丁修复等多种能力,以应对修复不完整补丁、添加新特性、接手他人代码等复杂场景。为此构建 USEbench,从 SWE-bench、SWT-bench、REPOCOD 等基准混合出覆盖编码、测试与打补丁的 1271 个仓库级任务。结果显示 USEagent 优于 OpenHands CodeActAgent 等通用智能体,在 SWE-bench 的 issue 解决上达到与 AutoCodeRover 等维护专用智能体相当的水平,且适用面更广;同时暴露出其在部分编码任务上的能力缺口。

问题
现有 LLM 智能体多为测试、调试、修复等特定软件任务构建的专用智能体,难以统一处理修复不完整补丁、添加新特性、接手他人代码等复杂开发场景,因此需要回答 LLM 智能体是否等同于 AI 软件工程师。
方法
构建统一软件工程智能体 USEagent,以 LLM 为推理引擎自主调用外部工具,编排并统一执行编码、测试、打补丁等多种能力;同时构建 USEbench,从 SWE-bench、SWT-bench、REPOCOD 等基准混合出仓库级多任务评测集。
评估
在 USEbench 的 1271 个仓库级软件工程任务上评估,USEagent 相比 OpenHands CodeActAgent 等通用智能体效果更好,在 SWE-bench 的 issue 解决任务上与 AutoCodeRover 等维护专用智能体相当,同时保持更广的任务适用性,并揭示其在部分编码任务上的能力缺口。
原文摘要(Abstract)

The growth of Large Language Model (LLM) technology has raised expectations for automated coding. However, software engineering is more than coding and is concerned with activities including maintenance and evolution of a project. In this context, the concept of LLM agents has gained traction, which utilize LLMs as reasoning engines to invoke external tools autonomously. But is an LLM agent the same as an AI software engineer? In this paper, we seek to understand this question by developing a Unified Software Engineering agent or USEagent. Unlike existing work which builds specialized agents for specific software tasks such as testing, debugging, and repair, our goal is to build a unified agent which can orchestrate and handle multiple capabilities. This gives the agent the promise of handling complex scenarios in software development such as fixing an incomplete patch, adding new features, or taking over code written by others. We envision USEagent as the first draft of a future AI Software Engineer which can be a team member in future software development teams involving both AI and humans. To evaluate the efficacy of USEagent, we build a Unified Software Engineering bench (USEbench) comprising of myriad tasks such as coding, testing, and patching. USEbench is a judicious mixture of tasks from existing benchmarks such as SWE-bench, SWT-bench, and REPOCOD. In an evaluation on USEbench consisting of 1,271 repository-level software engineering tasks, USEagent shows improved efficacy compared to existing general agents such as OpenHands CodeActAgent. For specific tasks such as issue resolution in SWE-bench, USEagent demonstrates efficacy comparable to agents such as AutoCodeRover (which are focused on software maintenance), while maintaining applicability to a broader range of software engineering tasks. There exist gaps in the capabilities of USEagent for certain coding tasks, which provides hints on further developing the AI Software Engineer of the future.

链接与引用

DOI 原文 · arXiv · DBLP

BibTeX
@inproceedings{abs-2506-14683,
  title = {Unified Software Engineering Agent as AI Software Engineer},
  author = {Leonhard Applis and Yuntong Zhang and Shanchao Liang and Nan Jiang and Lin Tan and Abhik Roychoudhury},
  booktitle = {ICSE},
  year = {2026},
  doi = {10.1145/3744916.3773202}
}