一句话:提出 FrUITeR 框架,在统一基准上自动、可复现地评估 UI 测试复用技术,并揭示现有工作遗漏的关键问题。
UI 测试由于需要大量人工投入而枯燥且耗时,近期研究尝试复用某个应用的既有 UI 测试,为其他应用自动生成新测试;然而这类技术的评估目前仍依赖人工、无法扩展且不可复现,既浪费精力又阻碍了这一新兴方向的进展。为此,作者提出 FrUITeR——一个以可复现方式自动评估 UI 测试复用的框架,并建立统一的评估基准,将 FrUITeR 应用于现有的测试复用技术。基于 20 个应用,共产生 11,917 个测试复用案例。论文报告了若干旨在改进 UI 测试复用的关键发现,这些发现是现有工作此前未能捕捉到的。
UI testing is tedious and time-consuming due to the manual effort required. Recent research has explored opportunities for reusing existing UI tests from an app to automatically generate new tests for other apps. However, the evaluation of such techniques currently remains manual, unscalable, and unreproducible, which can waste effort and impede progress in this emerging area. We introduce FrUITeR, a framework that automatically evaluates UI test reuse in a reproducible way. We apply FrUITeR to existing test-reuse techniques on a uniform benchmark we established, resulting in 11,917 test reuse cases from 20 apps. We report several key findings aimed at improving UI test reuse that are missed by existing work.
@inproceedings{paperbot5775,
title = {FrUITeR: a framework for evaluating UI test reuse},
author = {Yixue Zhao and Justin Chen and Adriana Sejfia and Marcelo Schmitt Laser and Jie Zhang and Federica Sarro and Mark Harman and Nenad Medvidovic},
booktitle = {FSE},
year = {2020},
doi = {10.1145/3368089.3409708}
}