一句话：通过实证研究揭示虚拟环境与物理环境性能测试结果的差异，并强调虚拟化开销可能导致结果失真。
大型软件系统通常通过性能测试验证其承载预期负载的能力，这类测试需生成高负载，因而消耗大量计算资源和时间，也要求测试环境持续更新。实践中，虚拟机常被用来提供灵活且低成本的性能测试环境，但虚拟机可能给测试环境引入额外开销（如异常高的内存占用和不稳定的 I/O 流量），导致性能测试结果不真实。现有研究对在性能测试中使用虚拟机如何影响测试结果关注不足。本文开展实证研究，对比虚拟环境与物理环境下的性能测试结果，考察二者差异以及虚拟机使用对性能测试活动的影响，为合理选择与解释性能测试环境提供依据。
Large software systems often undergo performance tests to ensure their capability to handle expected loads. These performance tests often consume large amounts of computing resources and time since heavy loads need to be generated. Making it worse, the ever evolving field requires frequent updates to the performance testing environment. In practice, virtual machines (VMs) are widely exploited to provide flexible and less costly environments for performance tests. However, the use of VMs may introduce confounding overhead (e.g., a higher than expected memory utilization with unstable I/O traffic) to the testing environment and lead to unrealistic performance testing results. Yet, little research has studied the impact on test results of using VMs in performance testing activities.
DOI 原文 ·
@inproceedings{paperbot4404,
title = {Empirical study on the discrepancy between performance testing results from virtual and physical environments},
author = {Muhammad Moiz Arif and Weiyi Shang and Emad Shihab},
booktitle = {ICSE},
year = {2018},
doi = {10.1145/3180155.3182527}
}