一句话:提出 dVermin,通过比较默认与大显示比例下视图的不一致性,自动检测移动应用 GUI 缩放问题。
移动应用 GUI 放大字体或显示尺寸可提升可读性与无障碍性,但容易引发文本截断、组件重叠等缩放问题,影响信息获取与流畅使用;现有 UI 显示问题检测和跨平台不一致检测方法对此效果不佳。本文提出自动化方法 dVermin,通过检测同一视图在默认显示比例与较大显示比例下的不一致性来发现缩放问题。评估中,dVermin 在问题页面检测上达到 97% 精确率和 97% 召回率,在问题视图检测上达到 84% 精确率和 91% 召回率,显著优于两个当前最优基线;在 F-droid 热门 Android 应用上还成功发现 21 个此前未检测到的缩放问题,其中 20 个已被确认或修复。
As the bridge between users and software, Graphical User Interface (GUI) is critical to the app accessibility. Scaling up the font or display size of GUI can help improve the visual impact, readability, and usability of an app, and is frequently used by the elderly and people with vision impairment. Yet this can easily lead to scaling issues such as text truncation, component overlap, which negatively influence the acquirement of the right information and the fluent usage of the app. Previous techniques for UI display issue detection and cross-platform inconsistency detection cannot work well for these scaling issues. In this paper, we propose an automated method, dVermin, for scaling issue detection, through detecting the inconsistency of a view under the default and a larger display scale. The evaluation result shows that dVermin achieves 97% precision and 97% recall in issue page detection, and 84% precision and 91% recall for issue view detection, outperforming two state-of-the-art baselines by a large margin. We also evaluate dVermin with popular Android apps on F-droid, and successfully uncover 21 previously-undetected scaling issues with 20 of them being confirmed/fixed.
@inproceedings{paperbot7367,
title = {The Metamorphosis: Automatic Detection of Scaling Issues for Mobile Apps},
author = {Yuhui Su and Chunyang Chen and Junjie Wang and Zhe Liu and Dandan Wang and Shoubin Li and Qing Wang},
booktitle = {ASE},
year = {2022},
doi = {10.1145/3551349.3556935}
}