一句话：通过工业案例研究揭示变异测试融入持续集成与开发者工作流的技术挑战、信息需求与可视化呈现，并给出实践建议。
变异测试是评估测试套件充分性的有效方法，近年来研究者不断提升其计算效率，新框架也层出不穷，但工业界的采用仍然有限。作者假设这一障碍源于缺乏关于如何在开发工作流中有效且高效使用变异测试的指导。为此，本文开展了一项工业案例研究，考察在持续集成中实施变异测试所面临的技术挑战、变异测试产生的哪些信息对开发者真正有用，以及这些信息应如何以文本和可视化形式呈现。研究结果揭示了集成变异测试的五项技术挑战，以及关于变异测试结果使用与呈现方式的九条关键发现。作者还提供了一个用于可视化变异测试结果的仪表盘，并给出 16 条在工业实践中有效运用变异测试的建议。
Mutation testing is a potentially effective method to assess test suite adequacy. Researchers have made mutation testing more computationally efficient, and new frameworks are regularly emerging. However, there is still limited adoption of mutation testing in industry. We hypothesize that such adoption is hindered by a lack of guidance on how to effectively and efficiently utilize mutation testing in a development workflow. To that end, we have conducted an industrial case study exploring the technical challenges of implementing mutation testing in continuous integration, what information from mutation testing is of use to developers, and how that information should be presented (in textual and visual form). Our results reveal five technical challenges of integrating mutation testing and nine key findings regarding how the results of mutation testing are used and presented. We also offer a dashboard to visualize mutation testing results, as well as 16 recommendations for making effective use of mutation testing in practice1.
DOI 原文 ·
@inproceedings{paperbot8271,
title = {Integrating Mutation Testing Into Developer Workflow: An Industrial Case Study},
author = {Stefan Alexander van Heijningen and Theo Wiik and Francisco Gomes de Oliveira Neto and Gregory Gay and Kim Viggedal and David Friberg},
booktitle = {ASE},
year = {2024},
doi = {10.1145/3691620.3695273}
}