paperbot · PL 论文追踪

全部论文 待读 收藏

P2 OwlEyes-online: a fully automated platform for detecting and localizing UI display issues

OwlEyes-online:一个用于检测与定位 UI 显示问题的全自动平台
FSE Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering2021匹配度 1/10 · 该论文聚焦 GUI/UI 显示问题的自动化检测与定位平台,属于软件测试与开发者工具方向,与用户关注的 PL 与 AI 交叉、静态分析、浮点程序分析、贝叶斯程序分析等核心研究方向基本无关。引用 15 inbox
Yuhui Su, Zhe Liu, Chunyang Chen, Junjie Wang, Qing Wang
crossref: 2026-09-12

AI 速览

一句话:实现全自动在线平台 OwlEyes-Online,可自动运行应用、检测并定位 UI 显示问题并生成测试报告。

GUI 是软件与终端用户之间的视觉桥梁,但受软硬件兼容性影响,文本重叠、画面模糊、图片缺失等 UI 显示问题在不同设备渲染时频繁出现。这类问题通常只能靠人眼发现,人工检查成本高且难以规模化。作者实现了在线工具 OwlEyes-Online,为用户提供简单易用的平台以实现 UI 显示问题的自动检测与定位:该工具自动运行应用并采集截图与 XML 文件,通过分析截图判断问题是否存在,并进一步定位问题在截图中的具体区域以提示开发者;最后自动生成包含所检测问题的测试报告并发送给用户。评估表明该工具能够准确检测 UI 显示问题。工具链接、GitHub 仓库与演示视频均已公开。

问题
GUI 在不同设备上渲染时会出现文本重叠、模糊、图片缺失等显示问题,而这类问题通常只能靠人眼发现,缺乏自动化的检测与定位手段。
方法
实现在线平台 OwlEyes-Online:自动运行应用并获取截图与 XML 文件,通过分析截图检测 UI 显示问题的存在,并定位问题在图中的具体区域,最终自动生成测试报告发送给用户。
评估
通过实验评估该工具,证明其能够准确检测 UI 显示问题;同时公开了在线工具、GitHub 仓库与演示视频。
原文摘要(Abstract)

Graphical User Interface (GUI) provides visual bridges between software apps and end users. However, due to the compatibility of software or hardware, UI display issues such as text overlap, blurred screen, image missing always occur during GUI rendering on different devices. Because these UI display issues can be found directly by human eyes, in this paper, we implement an online UI display issue detection tool OwlEyes-Online, which provides a simple and easy-to-use platform for users to realize the automatic detection and localization of UI display issues. The OwlEyes-Online can automatically run the app and get its screenshots and XML files, and then detect the existence of issues by analyzing the screenshots. In addition, OwlEyes-Online can also find the detailed area of the issue in the given screenshots to further remind developers. Finally, OwlEyes-Online will automatically generate test reports with UI display issues detected in app screenshots and send them to users. The OwlEyes-Online was evaluated and proved to be able to accurately detect UI display issues. Tool Link: http://www.owleyes.online:7476 Github Link: https://github.com/franklinbill/owleyes Demo Video Link: https://youtu.be/002nHZBxtCY

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot6426,
  title = {OwlEyes-online: a fully automated platform for detecting and localizing UI display issues},
  author = {Yuhui Su and Zhe Liu and Chunyang Chen and Junjie Wang and Qing Wang},
  booktitle = {FSE},
  year = {2021},
  doi = {10.1145/3468264.3473109}
}