一句话：提出图像与布局驱动的跨平台移动测试工具 LIRAT，首次实现测试脚本跨平台录制与回放。
移动平台碎片化问题覆盖 Android、iOS、移动 Web 和微信等多个平台，导致测试脚本难以跨平台运行。现有工具多采用传统计算机视觉技术在不同平台上回放同一脚本，但难以识别动态控件或相似控件，工程实用性受限。本文提出图像驱动的工具 LIRAT，用于跨平台录制与回放测试脚本，首次解决了测试脚本跨平台回放问题。LIRAT 记录控件的截图与布局信息，并在回放过程中利用图像理解技术定位控件；基于精确的控件定位，LIRAT 支持跨设备和跨平台的脚本回放。作者在 8 台 Android 设备和 2 台 iOS 设备上，对 5 个应用的 25 个脚本进行了回放评估，结果显示 Android 平台回放成功率为 88%，iOS 平台为 60%。演示地址见 GitHub。
The fragmentation issue spreads over multiple mobile platforms such as Android, iOS, mobile web, and WeChat, which hinders test scripts from running across platforms. To reduce the cost of adapting scripts for various platforms, some existing tools apply conventional computer vision techniques to replay the same script on multiple platforms. However, because these solutions can hardly identify dynamic or similar widgets. It becomes difficult for engineers to apply them in practice. In this paper, we present an image-driven tool, namely LIRAT, to record and replay test scripts cross platforms, solving the problem of test script cross-platform replay for the first time. LIRAT records screenshots and layouts of the widgets, and leverages image understanding techniques to locate them in the replay process. Based on accurate widget localization, LIRAT supports replaying test scripts across devices and platforms. We employed LIRAT to replay 25 scripts from 5 application across 8 Android devices and 2 iOS devices. The results show that LIRAT can replay 88% scripts on Android platforms and 60% on iOS platforms. The demo can be found at: https: //github.com/YSC9848/LIRAT.
DOI 原文 ·
@inproceedings{paperbot5233,
title = {LIRAT: Layout and Image Recognition Driving Automated Mobile Testing of Cross-Platform},
author = {Shengcheng Yu and Chunrong Fang and Yang Feng and Wenyuan Zhao and Zhenyu Chen},
booktitle = {ASE},
year = {2019},
doi = {10.1109/ase.2019.00103}
}