一句话:提出 DeFlaker,旨在高效检测与最新代码修改无关的 flaky test,避免昂贵的重复运行。
开发者常通过运行测试来确认最新修改未破坏已有功能。理想情况下,新出现的测试失败对应回归;但部分失败源于测试的非确定性,即 flaky test,与最新修改无关。检测 flaky test 的典型方法是反复重跑失败测试,但这一过程开销大,会拖慢开发周期。本文提出 DeFlaker,针对该问题展开研究。摘要未给出具体方法与评估细节,仅说明其目标是更高效地识别 flaky test。
Developers often run tests to check that their latest changes to a code repository did not break any previously working functionality. Ideally, any new test failures would indicate regressions caused by the latest changes. However, some test failures may not be due to the latest changes but due to non-determinism in the tests, popularly called flaky tests. The typical way to detect flaky tests is to rerun failing tests repeatedly. Unfortunately, rerunning failing tests can be costly and can slow down the development cycle.