paperbot · PL 论文追踪

全部论文 待读 收藏

P2 An LLM Assistant for Software Project Onboarding

面向软件项目入职的 LLM 助手
FSE Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering2025匹配度 2/10 · 该论文是面向软件项目入职的 LLM 问答工具,属于 LLM 辅助软件理解/开发者工具,不涉及静态分析、形式化验证、浮点程序分析或贝叶斯程序分析等核心方向;仅与“LLM 用于编程环境/开发者工具”有外围关联。引用 1 inbox
Knud Ronau Larsen, Magnus Edvall, Truong Ho-Quang, Felix Dobslaw, Rodi Jolak
crossref: 2026-09-12

AI 速览

一句话:开发基于 LLM 的项目问答工具 SPAC-B,帮助新成员理解软件项目并制定问题解决计划。

新开发者通常在中后期阶段加入软件团队,常因软件理解困难而难以做出早期贡献。为帮助新手理解项目,作者开发了基于 LLM 的工具 SPAC-B,能够回答与具体软件项目相关的问题。研究首先开展案例研究,在两个开源项目上评估 SPAC-B 回答常见开发者问题(用于解决 issue)时的相关性、完整性和正确性:在 1–5 的 Likert 量表上,相关性均值为 4.6,完整性与正确性均为 4.3。随后作者又进行了一项有十名软件开发者参与的实验,进一步考察该工具帮助新手制定真实开源 issue 解决方案计划的能力。结果表明,参与者在 SPAC-B 的辅助下能够制定出更好的实现计划,其中 8/10 的参与者认为该工具有所帮助。

问题
新加入成熟软件项目的开发者常因软件理解障碍而难以快速上手并做出早期贡献。
方法
开发基于 LLM 的项目专属问答工具 SPAC-B,并在两个开源项目上以案例研究评估其回答的相关性、完整性与正确性,另以十名开发者实验考察其辅助制定 issue 解决计划的效果。
评估
案例研究中答案在 1–5 Likert 量表上的相关性均值为 4.6,完整性与正确性均为 4.3;开发者实验显示参与者借助该工具能制定更好的实现计划,8/10 认为工具有帮助。
原文摘要(Abstract)

New developers commonly join software teams for projects in the advanced stages of development. They frequently face barriers, especially in software comprehension, that impede their ability to make early contributions. To aid newcomers in understanding software projects, we have developed an LLM-based tool called SPAC-B that can answer software project-specific questions. In this study, a case study is conducted to investigate the accuracy of SPAC-B's answers to common developer questions when resolving issues on two open-source projects regarding relevance, completeness, and correctness. On a Likert scale (1–5), answers from SPAC-B scored a mean of 4.6 in relevance and 4.3 in completeness and correctness. An experiment with ten software developers is performed to further examine SPAC-B's ability to help newcomers formulate plans for resolving real-life open-source issues. Results show that the participants could make a better implementation plan with the use of SPAC-B and 8/10 participants found the tool to be helpful.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot8978,
  title = {An LLM Assistant for Software Project Onboarding},
  author = {Knud Ronau Larsen and Magnus Edvall and Truong Ho-Quang and Felix Dobslaw and Rodi Jolak},
  booktitle = {FSE},
  year = {2025},
  doi = {10.1145/3696630.3728719}
}