一句话:实现全自动在线平台 OwlEyes-Online,可自动运行应用、检测并定位 UI 显示问题并生成测试报告。
GUI 是软件与终端用户之间的视觉桥梁,但受软硬件兼容性影响,文本重叠、画面模糊、图片缺失等 UI 显示问题在不同设备渲染时频繁出现。这类问题通常只能靠人眼发现,人工检查成本高且难以规模化。作者实现了在线工具 OwlEyes-Online,为用户提供简单易用的平台以实现 UI 显示问题的自动检测与定位:该工具自动运行应用并采集截图与 XML 文件,通过分析截图判断问题是否存在,并进一步定位问题在截图中的具体区域以提示开发者;最后自动生成包含所检测问题的测试报告并发送给用户。评估表明该工具能够准确检测 UI 显示问题。工具链接、GitHub 仓库与演示视频均已公开。
Graphical User Interface (GUI) provides visual bridges between software apps and end users. However, due to the compatibility of software or hardware, UI display issues such as text overlap, blurred screen, image missing always occur during GUI rendering on different devices. Because these UI display issues can be found directly by human eyes, in this paper, we implement an online UI display issue detection tool OwlEyes-Online, which provides a simple and easy-to-use platform for users to realize the automatic detection and localization of UI display issues. The OwlEyes-Online can automatically run the app and get its screenshots and XML files, and then detect the existence of issues by analyzing the screenshots. In addition, OwlEyes-Online can also find the detailed area of the issue in the given screenshots to further remind developers. Finally, OwlEyes-Online will automatically generate test reports with UI display issues detected in app screenshots and send them to users. The OwlEyes-Online was evaluated and proved to be able to accurately detect UI display issues. Tool Link: http://www.owleyes.online:7476 Github Link: https://github.com/franklinbill/owleyes Demo Video Link: https://youtu.be/002nHZBxtCY
@inproceedings{paperbot6426,
title = {OwlEyes-online: a fully automated platform for detecting and localizing UI display issues},
author = {Yuhui Su and Zhe Liu and Chunyang Chen and Junjie Wang and Qing Wang},
booktitle = {FSE},
year = {2021},
doi = {10.1145/3468264.3473109}
}