一句话:提出 PeASS 工具,通过重复测量单元测试性能并结合回归测试选择,识别代码版本间的性能变化与回归。
PeASS(Performance Analysis of Software System versions)是一个检测不同源代码版本间性能变化的工具。它通过测量单元测试在各版本中的性能来发现性能回归,并重复测量、使用 agnostic t-test 进行统计分析以保证严谨性;同时借助回归测试选择只执行最少必要测试。作者在多个 Apache Commons 项目上评估,表明 PeASS 能发现 81% 被单元测试覆盖的性能变化。该工具已开源并提供视频演示。
We present PeASS (Performance Analysis of Software System versions), a tool for detecting performance changes at source code level that occur between different code versions. By using PeASS, it is possible to identify performance regressions that happened in the past to fix them. PeASS measures the performance of unit tests in different source code versions. To achieve statistic rigor, measurements are repeated and analyzed using an agnostic t-test. To execute a minimal amount of tests, PeASS uses a regression test selection. We evaluate PeASS on a selection of Apache Commons projects and show that 81% of all unit test covered performance changes can be found by PeASS. A video presentation is available at https://www.youtube.com/watch?v=RORFEGSCh6Y and PeASS can be downloaded from https://github.com/DaGeRe/peass.
DOI 原文 ·
@inproceedings{paperbot5308,
title = {PeASS: A Tool for Identifying Performance Changes at Code Level},
author = {David Georg Reichelt and Stefan Kuhne and Wilhelm Hasselbring},
booktitle = {ASE},
year = {2019},
doi = {10.1109/ase.2019.00123}
}