一句话:提出基于无模型强化学习的自适应自主压力测试框架,无需系统性能模型即可学习生成压力测试条件的最优策略并复用于相似场景。
论文针对复杂软件系统压力测试中难以获取源代码或精确性能模型的问题,提出一种无模型强化学习驱动的自适应自主压力测试框架。该框架将压力测试用例生成建模为序贯决策问题,让智能测试体在缺乏被测系统性能模型的情况下,通过与系统交互学习生成压力测试条件的最优策略,并将学到的策略复用于相似场景以降低测试成本。实验分析表明,该框架能够高效、自适应地为不同软件系统生成压力测试条件,无需访问性能模型,验证了学习型测试代理在性能测试自动化中的可行性与有效性。
Automated testing activities like automated test case generation imply a reduction in human effort and cost, with the potential to impact the test coverage positively. If the optimal policy, i.e., the course of actions adopted, for performing the intended test activity could be learnt by the testing system, i.e., a smart tester agent, then the learnt policy could be reused in analogous situations which leads to even more efficiency in terms of required efforts. Performance testing under stress execution conditions, i.e., stress testing, which involves providing extreme test conditions to find the performance breaking points, remains a challenge, particularly for complex software systems. Some common approaches for generating stress test conditions are based on source code or system model analysis, or use-case based design approaches. However, source code or precise system models might not be easily available for testing. Moreover, drawing a precise performance model is often difficult, particularly for complex systems. In this research, I have used model-free reinforcement learning to build a self-adaptive autonomous stress testing framework which is able to learn the optimal policy for stress test case generation without having a model of the system under test. The conducted experimental analysis shows that the proposed smart framework is able to generate the stress test conditions for different software systems efficiently and adaptively without access to performance models.
DOI 原文 ·
@inproceedings{paperbot5085,
title = {Machine learning-assisted performance testing},
author = {Mahshid Helali Moghadam},
booktitle = {FSE},
year = {2019},
doi = {10.1145/3338906.3342484}
}