paperbot · PL 论文追踪

全部论文 待读 收藏

P2 ScholForge: A Multi-Agent LLM System for Autonomous Software Engineering Research

ScholForge:面向自主软件工程研究的多智能体 LLM 系统
FSE Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering2026匹配度 2/10 · 论文提出多智能体LLM系统用于自主软件工程研究,属于以LLM/Agent能力本身为研究目标,未涉及静态分析、浮点程序分析或贝叶斯程序分析等用户核心关注方向。虽然构建了Agentic程序,但并未对其进行程序分析,与用户“PL→AI”或“AI→PL”的研究问题不匹配。引用 0 inbox
Aleksei Stepin, Boris Tolstokulakov, Vladislav Kulikov, Artyom Kabanov, Vladimir Kubasov, Mikhail Mozikov, Ilya Gusev, Ilya Makarov
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出分层多智能体 LLM 系统 ScholForge,端到端自主完成软件工程研究并产出代码、实验与论文。

软件工程研究涵盖文献调研、软件构建、实验运行与论文写作等多个阶段,通常各阶段需要不同工具和专业知识,难以端到端自动化。本文提出 ScholForge,一个分层多智能体 LLM 系统:Manager 智能体通过 Code-Act 执行循环将任务委派给 Librarian、Proposer、MLE Solver、Writer 和 Reviewer 五个专家智能体,并通过三个 Model Context Protocol(MCP)服务器暴露外部能力。给定自然语言研究目标,系统无需人工干预即可生成可运行代码、实验结果与编译好的论文手稿。作者展示了一个代表性案例 Prompt2Edge:该系统自主开发了面向边缘设备的 agentic ML 流水线,在 Speech Commands 上以 17.8k 参数模型取得 86.71% 测试准确率,在 UCI HAR 上取得 0.9638 Macro-F1,消耗约 5M tokens,并在 5 小时内完成整个流程。

问题
软件工程研究涉及文献综述、软件构建、实验执行与论文写作等异质活动,各阶段依赖不同工具与专业知识,难以实现端到端自动化。
方法
提出分层多智能体 LLM 系统 ScholForge:Manager 通过 Code-Act 执行循环协调五个专家智能体(Librarian、Proposer、MLE Solver、Writer、Reviewer),并通过三个 MCP 服务器接入外部能力。
评估
以一个自然语言研究目标为输入,展示代表性案例 Prompt2Edge:系统自主开发面向边缘设备的 agentic ML 流水线,报告在 Speech Commands 与 UCI HAR 上的准确率/Macro-F1、参数规模及 token 与时间开销。
原文摘要(Abstract)

Software engineering research spans many activities: surveying literature, building software, running experiments, writing papers-that typically require different tools and expertise at each stage. We present a ScholForge - hierarchical multi-agent LLM system that tackles this end-to-end. Manager agent delegates to five specialists (Librarian, Proposer, MLE Solver, Writer, Reviewer) through a Code-Act execution loop, with external capabilities exposed via three Model Context Protocol (MCP) servers. Given a natural-language research goal, the system produces working code, experimental results, and a compiled manuscript without human intervention. We present one representative case study: Prompt2Edge, an autonomously developed agentic ML pipeline for edge devices that achieved 86.71% test accuracy on Speech Commands with a 17.8k-parameter model and 0.9638 Macro-F1 on UCI HAR, consuming approximately 5 M tokens and completing the full pipeline in under 5 hours.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{StepinTKKKMGM26,
  title = {ScholForge: A Multi-Agent LLM System for Autonomous Software Engineering Research},
  author = {Aleksei Stepin and Boris Tolstokulakov and Vladislav Kulikov and Artyom Kabanov and Vladimir Kubasov and Mikhail Mozikov and Ilya Gusev and Ilya Makarov},
  booktitle = {FSE},
  year = {2026},
  doi = {10.1145/3803437.3807394}
}