一句话:提出 XRintTest,通过 XR 用户交互图自动探索 Unity XR 场景并合成空间交互,实现高效测试。
扩展现实(XR)技术提供沉浸式体验,但其空间交互范式给测试带来独特挑战。现有工作主要通过场景导航和交互触发测试 XR 应用,却无法通过专用 XR 设备合成真实的空间输入,例如 6 自由度控制器手势,而这些输入对现代 XR 用户体验至关重要。为此,本文提出 XRintTest,一个面向基于 Unity 的 XR 应用的自动化测试框架。XRintTest 首先构建 XR 用户交互图,对交互目标及其所需事件进行建模;随后利用该图自动探索被测 XR 场景并生成用户交互。作者在 XRBench3D 上评估该框架,该基准包含 7 个 XR 场景和 367 个不同的 3D 用户交互。结果表明,XRintTest 对触发和抓取交互的覆盖率达到 97%,比随机探索有效 9 倍、高效 5 倍,并能检测运行时异常和功能缺陷。工具与数据集已开源。
Extended Reality (XR) technologies offer immersive user experiences across diverse application domains, presenting unique testing challenges due to their spatial interaction paradigms. While existing works test XR applications through scene navigation and interaction triggering, they fail to synthesise realistic spatial input via specialised XR devices, such as 6 degrees of freedom controller gestures, that are essential for modern XR user experiences. To address this gap, we present XRintTest, an automated testing framework for Unity-based XR applications. XRintTest starts by constructing an XR User Interaction Graph that models interaction targets and required events. Leveraging this graph, it then automatically explores the XR scene under test and generates user interactions. We evaluated XRintTest on XRBench3D, a novel benchmark comprising seven XR scenes containing 367 distinct 3D user interactions. XRintTest shows great effectiveness, achieving 97% coverage of trigger and grab interactions across all scenes, 9x more effective and 5x more efficient than random exploration, while detecting runtime exceptions and functional defects. We open-sourced our tool and dataset at https://github.com/ruizhengu/XRintTest and https://github.com/ruizhengu/XRBench3D, respectively. A video demo is available on YouTube at https://youtu.be/K0Q6waE47Us.
DOI 原文 ·
@inproceedings{paperbot9191,
title = {XRintTest: An Automated Framework for User Interaction Testing in Extended Reality Applications},
author = {Ruizhen Gu and José Miguel Rojas and Donghwan Shin},
booktitle = {ASE},
year = {2025},
doi = {10.1109/ase63991.2025.00363}
}