一句话:通过文献综述与三角互证复现研究,检验 Travis CI 情境下持续集成痛点既有结论的可复现性。
持续集成(CI)是成熟的软件质量保障实践,已有研究采用不同方法和人群考察其痛点。本文先综述 37 篇关于 CI 痛点的论文,再在 Travis CI 情境下开展概念性复现。作者采用三角互证设计:对 132 份问卷、12 次访谈以及 6,239 个 GitHub 项目上的两个逻辑回归模型进行综合分析,分别预测 Travis CI 的放弃和切换行为。研究汇报了哪些既有结果可复现、哪些出现冲突证据、哪些未获证据,并讨论这些发现对 CI 研究与工具实践的意义。
Continuous integration (CI) is an established software quality assurance practice, and the focus of much prior research with a diverse range of methods and populations. In this paper, we first conduct a literature review of 37 papers on CI pain points. We then conduct a conceptual replication study on results from these papers using a triangulation design consisting of a survey with 132 responses, 12 interviews, and two logistic regressions predicting Travis CI abandonment and switching on a dataset of 6,239 GitHub projects. We report and discuss which past results we were able to replicate, those for which we found conflicting evidence, those for which we did not find evidence, and the implications of these findings.
@inproceedings{paperbot5133,
title = {A conceptual replication of continuous integration pain points in the context of Travis CI},
author = {David Gray Widder and Michael Hilton and Christian Kästner and Bogdan Vasilescu},
booktitle = {FSE},
year = {2019},
doi = {10.1145/3338906.3338922}
}