paperbot · PL 论文追踪

全部论文 待读 收藏

Generation of Web Apps with Agentic IDEs: An Empirical Assessment

使用智能体 IDE 生成 Web 应用:一项实证评估
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026引用 0 inbox
Manuel Marceca, Maria Teresa Rossi, Leonardo Mariani
crossref: 2026-10-09

AI 速览

一句话:对比三种智能体 IDE 从零生成全栈 Web 应用,发现常见模式生成成熟、分布式架构错误显著更多。

智能体 IDE 借助基于 LLM 的智能体辅助开发,但其在端到端生成完整应用方面的评估仍有限。本文对 Copilot、Cursor 与 Windsurf 三种流行智能体 IDE 进行严格的对比分析,让它们从零生成五个全栈 Web 应用。结果显示,这些工具在 CRUD 操作、认证等成熟模式上已相当成熟,但在任务队列等较少见的分布式架构上会产生显著更多错误。总体而言,智能体 IDE 尚不能取代开发者,而是将其角色转变为通过自然语言指令与迭代精化来编排 LLM 智能体构建软件;各工具虽各有特点,但差异不大。

问题
智能体 IDE 在生成完整应用的端到端开发任务上的评估仍不充分,缺乏对多种工具生成能力的严格对比证据。
方法
对 Copilot、Cursor 与 Windsurf 三种流行智能体 IDE 从零生成五个全栈 Web 应用进行实证对比分析,考察其生成结果中的错误模式。
评估
通过对比各 IDE 在成熟模式(如 CRUD、认证)与较少见分布式架构(如任务队列)上的错误分布,评估其成熟度与差异。
原文摘要(Abstract)

Agentic IDEs are among the most significant innovations in software engineering, aiming to accelerate application development through LLM-based agents that can assist developers during development. However, their evaluation in end-to-end development tasks involving the generation of complete applications remains limited. To fill this gap, we propose a rigorous comparative analysis of three popular agentic IDEs (Copilot, Cursor, and Windsurf) in the generation of five full-stack Web applications from scratch. Results show high maturity in the generation of established patterns, such as CRUD operations and authentication features. In contrast, the generation of less common distributed architectures, such as a task queue architecture, produces significantly more errors. Overall, results show that Agentic IDEs cannot replace developers but shift their role toward building software by orchestrating LLM-based agents through natural-language instructions and iterative refinement. Yet, each agentic IDE shows its peculiarities, although differences are narrow.

链接与引用

DOI 原文 · arXiv ·

BibTeX
@inproceedings{paperbot12584,
  title = {Generation of Web Apps with Agentic IDEs: An Empirical Assessment},
  author = {Manuel Marceca and Maria Teresa Rossi and Leonardo Mariani},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3837506}
}