一句话:提出 PredART,通过截图采样、众包与混合神经网络预测虚拟对象放置的人类评分,作为 AR 自动化测试的测试预言。
增强现实应用常因虚拟对象放置错误而影响可用性与用户体验,但放置错误只能由人类感知且需多人确认,导致自动测试困难。本文提出 PredART,一种预测人类对虚拟对象放置评分的自动测试预言方法。PredART 采用自动截图采样、众包标注和混合神经网络进行图像回归,从而预测放置质量。在 480 张截图的测试集上,方法取得 85.0% 的准确率,MAE、MSE 和 RMSE 分别为 0.047、0.008 和 0.091,表明其可作为 AR 自动化测试的有效预言。
While the emerging Augmented Reality (AR) technique allows a lot of new application opportunities, from education and communication to gaming, current augmented apps often have complaints about their usability and/or user experience due to placement errors of virtual objects. Therefore, identifying noticeable placement errors is an important goal in the testing of AR apps. However, placement errors can only be perceived by human beings and may need to be confirmed by multiple users, making automatic testing very challenging. In this paper, we propose PredART, a novel approach to predict human ratings of virtual object placements that can be used as test oracles in automated AR testing. PredART is based on automatic screenshot sampling, crowd sourcing, and a hybrid neural network for image regression. The evaluation on a test set of 480 screenshots shows that our approach can achieve an accuracy of 85.0% and a mean absolute error, mean squared error, and root mean squared error of 0.047, 0.008, and 0.091, respectively.