一句话:通过可扩展框架CeitInspector在六个服务器应用上实证研究配置错误注入测试,揭示遗漏用例并给出改进建议。
配置错误注入测试(CEIT)能系统评估软件对运行时配置错误的可靠性与可诊断性。本文构建了可扩展、高模块化的CEIT框架CeitInspector,并在六个成熟且广泛使用的服务器应用上,对多种CEIT技术进行有效性与效率的定量测量。实验发现,大量测试用例未被先前工作覆盖,这些用例中的注入配置错误往往指示潜在误配置,可能成为系统中的定时炸弹并造成严重损害。作者对这些用例展开深入研究,揭示其根因并探索可能的补救措施,最终提出可操作建议,以改进现有CEIT技术的有效性与效率。
Configuration error injection testing (CEIT) could systematically evaluate software reliability and diagnosability to runtime configuration errors. This paper explores the challenges and opportunities of applying CEIT technique. We build an extensible, highly-modularized CEIT framework named CeitInspector to experiment with various CEIT techniques. Using CeitInspector, we quantitatively measure the effectiveness and efficiency of CEIT using six mature and widely-used server applications. During this process, we find a fair number of test cases are left unstudied by the prior research work. The injected configuration errors in these cases often indicate latent misconfigurations, which might be ticking time bombs in the system and lead to severe damage. We conduct an in-depth study regarding these cases to reveal the root causes, and explore possible remedies. Finally, we come up with actionable suggestions guided by our study to improve the effectiveness and efficiency of the existing CEIT techniques.
DOI 原文 ·
@inproceedings{paperbot6652,
title = {Challenges and opportunities: an in-depth empirical study on configuration error injection testing},
author = {Wang Li and Zhouyang Jia and Shanshan Li and Yuanliang Zhang and Teng Wang and Erci Xu and Ji Wang and Xiangke Liao},
booktitle = {ISSTA},
year = {2021},
doi = {10.1145/3460319.3464799}
}