paperbot · PL 论文追踪

全部论文 待读 收藏

P2 XRintTest: An Automated Framework for User Interaction Testing in Extended Reality Applications

XRintTest:面向扩展现实应用用户交互测试的自动化框架
ASE 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE)2025匹配度 1/10 · 论文主题为 XR 应用的自动化用户交互测试,核心是 Unity 场景探索与空间交互合成,与用户关注的 PL/AI、静态分析、LLM/Agent、浮点程序分析和贝叶斯程序分析均无直接关联,仅泛属于软件测试方向。引用 1 inbox
Ruizhen Gu, José Miguel Rojas, Donghwan Shin
crossref: 2026-09-12

AI 速览

一句话:提出 XRintTest,通过 XR 用户交互图自动探索 Unity XR 场景并合成空间交互,实现高效测试。

扩展现实(XR)技术提供沉浸式体验,但其空间交互范式给测试带来独特挑战。现有工作主要通过场景导航和交互触发测试 XR 应用,却无法通过专用 XR 设备合成真实的空间输入,例如 6 自由度控制器手势,而这些输入对现代 XR 用户体验至关重要。为此,本文提出 XRintTest,一个面向基于 Unity 的 XR 应用的自动化测试框架。XRintTest 首先构建 XR 用户交互图,对交互目标及其所需事件进行建模;随后利用该图自动探索被测 XR 场景并生成用户交互。作者在 XRBench3D 上评估该框架,该基准包含 7 个 XR 场景和 367 个不同的 3D 用户交互。结果表明,XRintTest 对触发和抓取交互的覆盖率达到 97%,比随机探索有效 9 倍、高效 5 倍,并能检测运行时异常和功能缺陷。工具与数据集已开源。

问题
现有 XR 应用测试方法难以通过专用 XR 设备合成真实空间输入,尤其是 6 自由度控制器手势,因此无法充分测试现代 XR 用户交互。
方法
提出 XRintTest,构建 XR 用户交互图来建模交互目标与所需事件,并基于该图自动探索 XR 场景、生成用户交互。
评估
在包含 7 个 XR 场景、367 个 3D 用户交互的 XRBench3D 基准上评估,达到 97% 的触发与抓取交互覆盖率,比随机探索有效 9 倍、高效 5 倍,并能发现运行时异常和功能缺陷。
原文摘要(Abstract)

Extended Reality (XR) technologies offer immersive user experiences across diverse application domains, presenting unique testing challenges due to their spatial interaction paradigms. While existing works test XR applications through scene navigation and interaction triggering, they fail to synthesise realistic spatial input via specialised XR devices, such as 6 degrees of freedom controller gestures, that are essential for modern XR user experiences. To address this gap, we present XRintTest, an automated testing framework for Unity-based XR applications. XRintTest starts by constructing an XR User Interaction Graph that models interaction targets and required events. Leveraging this graph, it then automatically explores the XR scene under test and generates user interactions. We evaluated XRintTest on XRBench3D, a novel benchmark comprising seven XR scenes containing 367 distinct 3D user interactions. XRintTest shows great effectiveness, achieving 97% coverage of trigger and grab interactions across all scenes, 9x more effective and 5x more efficient than random exploration, while detecting runtime exceptions and functional defects. We open-sourced our tool and dataset at https://github.com/ruizhengu/XRintTest and https://github.com/ruizhengu/XRBench3D, respectively. A video demo is available on YouTube at https://youtu.be/K0Q6waE47Us.

链接与引用

DOI 原文 ·

BibTeX
@inproceedings{paperbot9191,
  title = {XRintTest: An Automated Framework for User Interaction Testing in Extended Reality Applications},
  author = {Ruizhen Gu and José Miguel Rojas and Donghwan Shin},
  booktitle = {ASE},
  year = {2025},
  doi = {10.1109/ase63991.2025.00363}
}