一句话：提出并工业部署Ukwikora，静态持续检查Robot Framework关键字驱动验收测试，发现重复代码、死代码与测试依赖问题。
在敏捷开发中，自动化验收测试套件需要快速反馈代码变更质量。然而，由多名自动化测试人员编写的测试套件不断膨胀，容易引入测试坏味（设计不良的测试代码），进而增加维护和新增测试的成本。本文在工业合作伙伴BGL BNP Paribas的背景下研究该问题，提出Ukwikora：一个静态分析验收测试套件、支持持续检查测试代码库的自动化工具。Ukwikora面向Robot Framework语法，这是一种流行的关键字驱动测试框架。该工具已在BGL BNP Paribas成功部署，能够检测出测试人员此前未知的问题，例如重复测试代码、死测试代码以及测试之间的依赖问题。案例研究的成功表明，验收测试套件仍需更多研究与工具支持。
Automation of acceptance test suites becomes necessary in the context of agile software development practices, which require rapid feedback on the quality of code changes. To this end, companies try to automate their acceptance tests as much as possible. Unfortunately, the growth of the automated test suites, by several automation testers, gives rise to potential test smells, i.e., poorly designed test code, being introduced in the test code base, which in turn may increase the cost of maintaining the code and creating new one. In this paper, we investigate this problem in the context of our industrial partner, BGL BNP Paribas, and introduce Ukwikora, an automated tool that statically analyzes acceptance test suites, enabling the continuous inspection of the test code base. Ukwikora targets code written in the Robot Framework syntax, a popular framework for writing Keyword-Driven tests. Ukwikora has been successfully deployed at BGL BNP Paribas, detecting issues otherwise unknown to the automation testers, such as the presence of duplicated test code, dead test code and dependency issues among the tests. The success of our case study reinforces the need for additional research and tooling for acceptance test suites.
DOI 原文 ·
@inproceedings{paperbot5351,
title = {Ukwikora: continuous inspection for keyword-driven testing},
author = {Renaud Rwemalika and Marinos Kintis and Mike Papadakis and Yves Le Traon and Pierre Lorrach},
booktitle = {ISSTA},
year = {2019},
doi = {10.1145/3293882.3339003}
}