一句话:提出 AnswerBot,针对技术问题自动检索相关问句并生成多样化答案摘要,每查询耗时从 309 秒降至 8 秒。
软件问答站点(如 Stack Overflow)是开发者日常解决问题的重要资源,但搜索引擎返回的相关帖子高度冗余、信息量过大,阻碍开发者消化并识别有用答案。本文提出工具 AnswerBot,可为给定技术问题自动生成答案摘要,包含三个阶段:相关问句检索、有用答案段落选择、多样化答案摘要生成,并以搜索引擎网站的形式实现。评估上,作者先从 Stack Overflow 构建包含大量 Java 问题及对应答案的语料库,再针对 100 个查询开展用户研究,将 AnswerBot 与基于 Google 和 Stack Overflow 搜索引擎的两个基线对比。结果显示 AnswerBot 生成的摘要在相关性、有用性和多样性上均更优,且效率从每查询 309 秒大幅提升至 8 秒。
Software Q&A sites (like Stack Overflow) play an essential role in developers’ day-to-day work for problem-solving. Although search engines (like Google) are widely used to obtain a list of relevant posts for technical problems, we observed that the redundant relevant posts and sheer amount of information barriers developers to digest and identify the useful answers. In this paper, we propose a tool AnswerBot which enables to automatically generate an answer summary for a technical problem. AnswerBot consists of three main stages, (1) relevant question retrieval, (2) useful answer paragraph selection, (3) diverse answer summary generation. We implement it in the form of a search engine website. To evaluate AnswerBot, we first build a repository includes a large number of Java questions and their corresponding answers from Stack Overflow. Then, we conduct a user study that evaluates the answer summary generated by AnswerBot and two baselines (based on Google and Stack Overflow search engine) for 100 queries. The results show that the answer summaries generated by AnswerBot are more relevant, useful, and diverse. Moreover, we also substantially improved the efficiency of AnswerBot (from 309 to 8 seconds per query).
DOI 原文 ·
@inproceedings{paperbot5156,
title = {AnswerBot: an answer summary generation tool based on stack overflow},
author = {Liang Cai and Haoye Wang and Bowen Xu and Qiao Huang and Xin Xia and David Lo and Zhenchang Xing},
booktitle = {FSE},
year = {2019},
doi = {10.1145/3338906.3341186}
}