一句话：提出基于EAT建模与PFSM的VR场景探索测试工具VRExplorer，显著提升覆盖并发现真实缺陷。
随着VR应用规模和复杂度快速增长，VR软件质量保障面临独特挑战：虚拟对象交互多样、3D环境复杂、任务执行序列繁琐，现有测试工具难以系统有效地测试VR应用。本文提出模型驱动的测试工具VRExplorer，用于与多样虚拟对象交互并探索复杂VR场景。作者设计了Entity、Action、Task（EAT）框架，以通用方式对VR交互建模；在此基础上构建VRExplorer智能体，将精心设计的寻路算法融入Unity NavMesh以实现场景探索，并利用概率有限状态机（PFSM）系统化执行交互决策。在11个代表性VR项目上的实验表明，VRExplorer在可执行代码行覆盖率和函数覆盖率上分别最高比SOTA方法VRGuide提升122.8%和52.8%，效率也更优；消融实验验证了各模块的贡献，并在真实项目中检测到两个功能性缺陷和一个非功能性缺陷。
With the proliferation of Virtual Reality (VR) markets, VR applications are rapidly expanding in scale and complexity, thereby driving an urgent need for assuring VR software quality. Different from traditional mobile applications and computer software, VR testing faces unique challenges due to diverse interactions with virtual objects, complex 3D virtual environments, and intricate sequences to complete tasks. All of these emerging challenges hinder existing VR testing tools from effectively and systematically testing VR applications. In this paper, we present VRExplorer, a novel model-based testing tool to effectively interact with diverse virtual objects and explore complex VR scenes. Particularly, we design the Entity, Action, and Task (EAT) framework for modeling diverse VR interactions in a generic way. Built upon the EAT framework, we then present the VRExplorer agent, which can achieve effective scene exploration by incorporating meticulously designed path-finding algorithms into Unity’s NavMesh. Moreover, the VRExplorer agent can also systematically execute interaction decisions on top of the Probabilistic Finite State Machine (PFSM). Experimental evaluation on 11 representative VR projects shows that VRExplorer consistently outperforms the state-of-the-art (SOTA) approach VRGuide by achieving significantly higher coverage and better efficiency. Specifically, VRExplorer yields up to 122.8% and 52.8% improvements over VRGuide in terms of executable lines of code (ELOC) coverage and method (function) coverage, respectively. Furthermore, ablation results also verify the essential contributions of each designed module. More importantly, our VRExplorer has successfully detected two functional bugs and one non-functional bug from real-world projects.
@inproceedings{paperbot9299,
title = {VRExplorer: A Model-based Approach for Semi-Automated Testing of Virtual Reality Scenes},
author = {Zhengyang Zhu and Hong-Ning Dai and Hanyang Guo and Zeqin Liao and Zibin Zheng},
booktitle = {ASE},
year = {2025},
doi = {10.1109/ase63991.2025.00047}
}