一句话:提出众包测试平台 CoCoTest,通过集体智能协作生成、聚合与推荐 Bug 报告,提升报告质量并降低测试成本。
Android 应用因碎片化与使用场景复杂而难以测试,众包测试虽成趋势,但工人专业性和沟通不足,常提交低质量、重复的缺陷报告,浪费审查与聚合资源。本文提出 CoCoTest 平台,借助 Android SDK 让工人高效截图、填写简短描述并创建缺陷报告。报告在线聚合后实时推荐给其他工人,使其能够相互评审、验证和丰富报告,避免重复提交,并在集体智能引导下开展更专业的测试。作者声称该平台可提升最终报告质量并降低测试成本,摘要以功能说明与演示视频为主,未报告量化实验。
Testing Android applications is becoming more and more challenging due to the notorious fragmentation issues and the complexity of usage scenarios in different environments. Crowdsourced testing has grown as a trend, especially in mobile application testing. However, due to the lack of professionalism and communication, the crowd workers tend to submit low-quality and duplicate bug reports, leading to a waste of test resources on inspecting and aggregating such reports. To solve these problems, we developed a platform, CoCoTest, embracing the idea of collective intelligence. With the help of CoCoTest Android SDK, workers can efficiently capture a screenshot, write a short description and create a bug report. A series of bug reports are aggregated online and then recommended to the other workers in real time. The crowdsourced workers can (1) help review, verify and enrich each others' bug reports; (2) escape duplicate bug reports; (3) be guided to conduct more professional testing with the help of collective intelligence. CoCoTest can improve the quality of the final report and reduce test costs. The demo video can be found at https://youtu.be/PuVuPbNP4tY.
DOI 原文 ·
@inproceedings{paperbot5342,
title = {CoCoTest: collaborative crowdsourced testing for Android applications},
author = {Haoyu Li and Chunrong Fang and Zhibin Wei and Zhenyu Chen},
booktitle = {ISSTA},
year = {2019},
doi = {10.1145/3293882.3339000}
}