一句话:提出 Euler,自动识别并评估缺陷报告中复现步骤的质量,并向报告者提供改进反馈。
用户编写的缺陷报告常因复现步骤质量低而增加缺陷分诊与修复成本。本文提出 Euler,自动从缺陷报告中识别已有及缺失的复现步骤,并评估其质量,进而向报告者生成可操作的反馈。为评估该方法,作者邀请外部评估者进行人工判断。结果显示,Euler 能正确识别 98% 的已有复现步骤和 58% 的缺失步骤,其质量标注有 73% 被判定为正确。该工作表明自动质量评估与反馈有助于改善缺陷报告。
A major problem with user-written bug reports, indicated by developers and documented by researchers, is the (lack of high) quality of the reported steps to reproduce the bugs. Low-quality steps to reproduce lead to excessive manual effort spent on bug triage and resolution. This paper proposes Euler, an approach that automatically identifies and assesses the quality of the steps to reproduce in a bug report, providing feedback to the reporters, which they can use to improve the bug report. The feedback provided by Euler was assessed by external evaluators and the results indicate that Euler correctly identified 98% of the existing steps to reproduce and 58% of the missing ones, while 73% of its quality annotations are correct.
@inproceedings{paperbot5036,
title = {Assessing the quality of the steps to reproduce in bug reports},
author = {Oscar Chaparro and Carlos Bernal-Cárdenas and Jing Lu and Kevin Moran and Andrian Marcus and Massimiliano Di Penta and Denys Poshyvanyk and Vincent Ng},
booktitle = {FSE},
year = {2019},
doi = {10.1145/3338906.3338947}
}