paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Towards Leveraging LLMs for Reducing Open Source Onboarding Information Overload

迈向利用 LLM 缓解开源上手文档的信息过载
ASE Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering2024匹配度 1/10 · 该论文聚焦用 LLM 简化开源 onboarding 文档以缓解信息过载,属于开发者文档与体验研究,不涉及静态分析、程序分析、形式化验证、浮点程序分析、贝叶斯程序分析或 Agentic 程序分析。且仅使用 GPT-3.5 Turbo 与 Gemini Pro 等较旧模型,与用户画像的核心方向基本无关。引用 2 inbox
Elijah Kayode Adejumo, Brittany Johnson
crossref: 2026-09-12

AI 速览

一句话:以 ChatGPT(GPT-3.5 Turbo)与 Gemini Pro 为案例,评估 LLM 简化开源新人上手文档以缓解信息过载的可行性。

开源社区的可持续性依赖持续、多样且高质量的贡献,因此有效的新人上手与留存机制至关重要。多数开源项目依靠 onboarding 文档帮助新人完成首次贡献,但已有研究表明,文档带来的信息过载以及仓库普遍单一语言(英语)的特性,会损害新人体验与上手过程;与此同时,编写与维护这类文档本身也耗费大量精力。作者认为大语言模型可帮助生成更易获取的文档,从而降低信息过载风险。论文以 ChatGPT(GPT-3.5 Turbo)和 Gemini Pro 为案例,评估 LLM 在简化软件 onboarding 文档这一具体方法上的有效性,并在此基础上提出利用 LLM 支持更具可访问性文档创建的更广阔愿景与未来研究方向。

问题
开源项目依赖 onboarding 文档支持新人贡献,但信息过载和仓库以英语为主等问题会负面影响新人上手体验,而创建与维护这些文档又成本高昂。
方法
以 ChatGPT(GPT-3.5 Turbo)和 Gemini Pro 为案例研究,考察 LLM 对软件 onboarding 文档进行简化改写、以降低信息过载的有效性。
评估
通过两个 LLM 的案例研究评估其简化 onboarding 文档的效果,并据此讨论支持可访问文档创作的更广泛愿景与后续研究方向。
原文摘要(Abstract)

Consistent, diverse, and quality contributions are essential to the sustainability of the open source community. Therefore, it is important that there is infrastructure for effectively onboarding and retaining diverse newcomers to open source software projects. Most often, open source projects rely on onboarding documentation to support newcomers in making their first contributions. Unfortunately, prior studies suggest that information overload from available documentation, along with the predominantly monolingual nature of repositories, can have negative effects on the newcomer experiences and onboarding process. This, coupled with the effort involved in creating and maintaining onboarding documentation, suggest a need for support in creating more accessible documentation. Large language models (LLMs) have shown great potential in providing text transformation support in other domains, and even shown promise in simplifying or generating other kinds of computing artifacts, such as source code and technical documentation. We contend that LLMs can also help make software onboarding documentation more accessible, thereby reducing the potential for information overload. Using ChatGPT (GPT-3.5 Turbo) and Gemini Pro as case studies, we assessed the effectiveness of LLMs for simplifying software onboarding documentation, one method for reducing information overload. We discuss a broader vision for using LLMs to support the creation of more accessible documentation and outline future research directions toward this vision.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot8295,
  title = {Towards Leveraging LLMs for Reducing Open Source Onboarding Information Overload},
  author = {Elijah Kayode Adejumo and Brittany Johnson},
  booktitle = {ASE},
  year = {2024},
  doi = {10.1145/3691620.3695286}
}