一句话：构建真实世界缺陷基准，系统评估 Android 自动化 GUI 测试工具发现崩溃缺陷的有效性与彻底性。
过去十年，Android 自动化 GUI 测试在应用可靠性保障上持续进步，已有数十种技术和工具能检测崩溃缺陷，并常宣称优于先前工作。然而，这些工具在实践中到底能多有效、多彻底地发现崩溃缺陷，仍缺乏基于真实缺陷的 ground-truth 基准来回答。既有研究多局限于若干选定应用的工具比较，无法给出直接而深入的结论。为此，本文构建面向真实世界崩溃缺陷的基准，并据此对 Android 自动化 GUI 测试进行基准评测，以系统考察其实际缺陷发现能力，填补缺乏统一实证标准的空白。
For ensuring the reliability of Android apps, there has been tremendous, continuous progress on improving automated GUI testing in the past decade. Specifically, dozens of testing techniques and tools have been developed and demonstrated to be effective in detecting crash bugs and outperform their respective prior work in the number of detected crashes. However, an overarching question "How effectively and thoroughly can these tools find crash bugs in practice?" has not been well-explored, which requires a ground-truth benchmark with real-world bugs. Since prior studies focus on tool comparisons w.r.t. some selected apps, they cannot provide direct, in-depth answers to this question.
DOI 原文 ·
@inproceedings{paperbot6413,
title = {Benchmarking automated GUI testing for Android against real-world bugs},
author = {Ting Su and Jue Wang and Zhendong Su},
booktitle = {FSE},
year = {2021},
doi = {10.1145/3468264.3468620}
}