一句话:将 CI 中测试用例的分布式执行建模为多目标优化问题,在租用服务器成本与测试执行时间之间寻找权衡。
该论文关注持续集成(CI)环境下测试活动的加速问题。作者提出将测试用例(TC)的执行分布到地理上分散的服务器上,并将测试用例在服务器间的分配与执行建模为一个多目标优化问题,目标是在租用服务器的成本与执行给定测试套件(TS)所需时间之间取得平衡。初步评估表明:在所研究场景中存在成本与执行时间之间的 Pareto 前沿,即两者存在权衡;并且与传统的非分布式(单服务器/PC)测试套件执行相比,所找到的分布式方案具有实际价值。尽管结果尚未定论,但作者认为这些方案有助于加快 CI 中的测试活动。
I present here a part of the research conducted in my Ph.D. course. In particular, I focus on my ongoing work on how to support testing in the context of Continuous Integration (CI) development by distributing the execution of test cases (TCs) on geographically dispersed servers. I show how to find a trade-off between the cost of leased servers and the time to execute a given test suite (TS). The distribution and the execution of TCs on servers is modeled as a multi-objective optimization problem, where the goal is to balance the cost to lease servers and the time to execute TCs. The preliminary results : (i) show evidence of the existence of a Pareto Front (trade-off between costs to lease servers and TCs time) and (ii) suggest that the found solutions are worthwhile as compared to a traditional non-distributed TS execution (i.e., a single server/PC). Although the obtained results cannot be considered conclusive, it seems that the solutions are worth to speed up the testing activities in the context of CI.
DOI 原文 ·
@inproceedings{paperbot5052,
title = {Distributed execution of test cases and continuous integration},
author = {Carmen Coviello},
booktitle = {FSE},
year = {2019},
doi = {10.1145/3338906.3341460}
}