一句话：首个跨平台 GUI 测试迁移中基于视觉控件映射的系统性研究，构建数据集并评估 89 种配置。
本文关注跨平台 GUI 测试复用中的控件映射问题。已有研究期望基于视觉的方法能提供平台无关的解决方案，因为语义相似的控件在不同平台版本上外观常相似，但其在跨平台迁移中的实际效果有限且原因不明。作者构建了包含 iOS 与 Android 平台 6,730 个双向映射控件对的数据集，并将映射控件分为八类；基于五种视觉控件映射方法实例化 89 种配置，利用该数据集系统评估。结果表明：部分配置优于现有方法，说明仍有提升空间；某些特征会产生负面影响，需要重新考量；大量映射控件外观内容不一致，需更复杂的视觉算法。
Automated GUI testing through the reuse of existing tests has recently gained prominence in research. Cross-platform migration of GUI tests between different platform versions of an application offers a promising opportunity for test reuse. Widget mapping, identifying similarities between source and target application widgets and connecting semantically analogous pairs, is central to these approaches. Vision-based widget mapping approaches are supposed to provide platform-agnostic solutions more suitable for cross-platform migration, considering that different platform versions frequently display strong resemblances in the appearance of their semantically similar widgets. However, the efficacy of vision-based widget mapping for cross-platform migration remains limited and the reasons remain unclear. In this paper, we present the first comprehensive investigation of vision-based widget mapping for cross-platform GUI test migration. We devote considerable effort to constructing a dataset consisting of 6,730 bi-directional mapped widget pairs across the iOS and Android platforms, and categorize the mapped widgets into eight classifications to thoroughly assess the capabilities of various approaches. We implement 89 configurations, derived from five distinct vision-based widget mapping methodologies, and evaluate their performance utilizing our dataset. Our findings reveal valuable insights that can be employed to advance vision-based widget mapping techniques: (1) The current approach exhibits potential for improvement, as certain configurations demonstrate superior performance in comparison to existing methods; (2) Some features can adversely impact the mapping, requiring more consideration; (3) A substantial proportion of mapped widgets display varying inconsistent contents in their appearance, which require more sophisticated vision algorithms.
@inproceedings{JiZZCPZ23,
title = {Vision-Based Widget Mapping for Test Migration Across Mobile Platforms: Are We There Yet?},
author = {Ruihua Ji and Tingwei Zhu and Xiaoqing Zhu and Chunyang Chen and Minxue Pan and Tian Zhang},
booktitle = {ASE},
year = {2023},
doi = {10.1109/ase56229.2023.00068}
}