一句话:针对异步 flaky 测试,提出自动修复工具 FlakeSync,以替代不可靠的等待时间调整。
回归测试常受 flaky 测试困扰:同一代码上非确定性通过或失败,误导开发者。异步 flaky 测试是一类常见情况,由时序问题导致,例如异步等待未及时返回或线程交错不同。开发者通常通过插入或增加等待时间来修复,但这类修复不可靠。论文提出 FlakeSync,旨在自动修复异步 flaky 测试。所给摘要仅说明了问题与现有做法的不足,未给出 FlakeSync 的具体方法、实现细节与实验评估结果。
Regression testing is an important part of the development process but suffers from the presence of flaky tests. Flaky tests nondeterministically pass or fail when run on the same code, misleading developers about the correctness of their changes. A common type of flaky tests are async flaky tests that flakily fail due to timing-related issues such as asynchronous waits that do not return in time or different thread interleavings during execution. Developers commonly try to repair async flaky tests by inserting or increasing some wait time, but such repairs are unreliable.