一句话:提出以好奇心为内在激励的强化学习智能体,用于 3D 游戏的自动化试玩测试。
游戏产业规模庞大,但游戏测试仍主要依赖人工试玩与脚本化测试,成本高且难以应对日益复杂、强交互的 3D 游戏。本文探索用自主智能体替代人工进行 play-testing:作者将 3D 游戏的自动化测试建模为强化学习问题,让智能体直接从玩游戏的过程中学习,无需人工干预,从而补充现有脚本化与自动化测试方案。为缓解稀疏奖励下的探索难题,方法引入“好奇心”作为内在激励因素,驱动智能体更充分地探索游戏环境、触发更多样的游戏行为与状态。作者开展了一项探索性研究,结果具有前景,并给出初步证据表明强化学习可用于 3D 游戏的自动化测试。
Computer game is a billion-dollar industry and is booming. Testing games has been recognized as a difficult task, which mainly relies on manual playing and scripting based testing. With the advances in technologies, computer games have become increasingly more interactive and complex, thus play-testing using human participants alone has become unfeasible. In recent days, play-testing of games via autonomous agents has shown great promise by accelerating and simplifying this process. Reinforcement Learning solutions have the potential of complementing current scripted and automated solutions by learning directly from playing the game without the need of human intervention. This paper presented an approach based on reinforcement learning for automated testing of 3D games. We make use of the notion of curiosity as a motivating factor to encourage an RL agent to explore its environment. The results from our exploratory study are promising and we have preliminary evidence that reinforcement learning can be adopted for automated testing of 3D games.