paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Automated Summarization of Stack Overflow Posts

Stack Overflow 帖子的自动摘要
ICSE 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)2023匹配度 2/10 · 该论文将深度学习用于 Stack Overflow 帖子自动摘要,属于机器学习与软件开发工具的交叉,但与用户关注的静态分析、Agentic 程序、浮点程序分析或贝叶斯程序分析均无直接关系。其方法基于 BERT 而非当前强 LLM/Agent,也未涉及程序分析或形式化验证。引用 20 inbox
Bonan Kou, Muhao Chen, Tianyi Zhang
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:提出深度学习框架 Assort,用于 Stack Overflow 帖子自动摘要,覆盖有监督与零样本设定并显著优于基线。

开发者常依赖 Stack Overflow 解决编程问题,但相关帖子众多,浏览和比较答案费时费力。已有自动摘要方法多依赖信息检索或启发式规则,难以处理自然语言的歧义与复杂性。本文提出基于深度学习的 SO 帖子摘要框架 Assort,包含两种互补学习方式:Assort_S 直接训练集成学习模型,结合 BERT 嵌入与领域特征以刻画 SO 帖子特性;Assort_IS 在无标注数据时复用预训练模型,并应对零样本学习中的领域偏移。在评估中,Assort_S 与 Assort_IS 的 F1 分别至少比六个基线高 13% 和 7%。人类研究显示参与者更偏好二者生成的摘要,且二者间偏好差异较小。

问题
Stack Overflow 帖子数量庞大,开发者难以快速浏览和比较不同解决方案;现有自动摘要方法依赖信息检索或启发式规则,不足以处理自然语言歧义与复杂性。
方法
提出 Assort 框架,包含 Assort_S(用 BERT 嵌入和领域特征训练集成模型)与 Assort_IS(复用预训练模型并应对零样本领域偏移),以在有/无标注数据场景下生成 SO 帖子摘要。
评估
在 SO 帖子摘要任务上对比六个现有方法,以 F1 评估,并辅以人类偏好研究,验证 Assort_S 和 Assort_IS 均优于基线且摘要更受开发者偏好。
原文摘要(Abstract)

Software developers often resort to Stack Overflow (SO) to fill their programming needs. Given the abundance of relevant posts, navigating them and comparing different solutions is tedious and time-consuming. Recent work has proposed to automatically summarize SO posts to concise text to facilitate the navigation of SO posts. However, these techniques rely only on information retrieval methods or heuristics for text summarization, which is insufficient to handle the ambiguity and sophistication of natural language. This paper presents a deep learning based framework called Assortfor SO post summarization. Assortincludes two complementary learning methods, $\mathbf{Assort}_{S}$ and $\mathbf{Assort}_{IS}$, to address the lack of labeled training data for SO post summarization. $\mathbf{Assort}_{S}$ is designed to directly train a novel ensemble learning model with BERT embeddings and domain-specific features to account for the unique characteristics of SO posts. By contrast, $\mathbf{Assort}_{IS}$ is designed to reuse pre-trained models while addressing the domain shift challenge when no training data is present (i.e., zero-shot learning). Both $\mathbf{Assort}_{S}$ and $\mathbf{Assort}_{IS}$ outperform six existing techniques by at least 13% and 7% respectively in terms of the F1 score. Furthermore, a human study shows that participants significantly preferred summaries generated by $\mathbf{Assort}_{S}$ and $\mathbf{Assort}_{IS}$ over the best baseline, while the preference difference between $\mathbf{Assort}_{S}$ and $\mathbf{Assort}_{IS}$ was small.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{abs-2305-16680,
  title = {Automated Summarization of Stack Overflow Posts},
  author = {Bonan Kou and Muhao Chen and Tianyi Zhang},
  booktitle = {ICSE},
  year = {2023},
  doi = {10.1109/icse48619.2023.00158}
}