一句话:提出动态重配置软件微基准的方法,在保持结果质量的同时降低执行时间,使持续集成中的频繁性能检查可行。
论文关注软件微基准测试套件执行成本过高的问题:完整套件常需数小时甚至数天,导致难以在持续集成等场景中频繁运行;但若为缩短时间而随意调整基准配置,又会使结果无法代表软件的真实性能。为此,作者提出对软件微基准进行动态重配置的思路,在降低执行时间的同时显式保证结果质量,避免配置变化引入不具代表性的性能结论。摘要主要给出问题动机与目标,未展开具体重配置策略、算法或实验数据;其核心主张是能够在不牺牲结果质量的前提下减少微基准执行开销,从而使更频繁的性能检查变得可行。
Executing software microbenchmarks, a form of small-scale performance tests predominantly used for libraries and frameworks, is a costly endeavor. Full benchmark suites take up to multiple hours or days to execute, rendering frequent checks, e.g., as part of continuous integration (CI), infeasible. However, altering benchmark configurations to reduce execution time without considering the impact on result quality can lead to benchmark results that are not representative of the software’s true performance.
@inproceedings{paperbot5845,
title = {Dynamically reconfiguring software microbenchmarks: reducing execution time without sacrificing result quality},
author = {Christoph Laaber and Stefan Würsten and Harald C. Gall and Philipp Leitner},
booktitle = {FSE},
year = {2020},
doi = {10.1145/3368089.3409683}
}