一句话：提出流程驱动的测试自动化方案，让无编程技能的测试分析师用自然语言步骤组合创建与执行自动化测试用例。
该工业报告针对测试自动化工程师资源昂贵、而具备领域知识的测试分析师通常缺乏编程技能这一矛盾，提出一种流程驱动的测试自动化方案。方案中，测试自动化工程师负责实现可自动执行的测试步骤（对应用户在待测系统中的动作），并用非技术人员可理解的自然语言加以描述；测试分析师则结合测试输入组合这些自动化步骤，构造、修改和执行完整的自动化测试用例，全程无需编程。作者还改进了基准测试自动化架构，以更好地分离和共享工程师与分析师的职责，并提出一种度量二者协作效果的指标。该方案基于挪威国家电子健康服务 Helsenorg（去年月访问量超百万）的开发与维护经验定义，并持续用于回归测试的自动化执行。
We present a process driven test automation solution which enables delegating (part of) automation tasks from test automation engineer (expensive resource) to test analyst (non-developer, less expensive). In our approach, a test automation engineer implements test steps (or actions) which are executed automatically. Such automated test steps represent user actions in the system under test and specified by a natural language which is understandable by a non-technical person. Then, a test analyst with a domain knowledge organizes automated steps combined with test input to create an automated test case. It should be emphasized that the test analyst does not need to possess programming skills to create, modify or execute automated test cases. We refine benchmark test automation architecture to be better suitable for an effective separation and sharing of responsibilities between the test automation engineer (with coding skills) and test analyst (with a domain knowledge). In addition, we propose a metric to empirically estimate cooperation between test automation engineer and test analyst's works. The proposed automation solution has been defined based on our experience in the development and maintenance of Helsenorg, the national electronic health services in Norway which has had over one million of visits per month past year, and we still use it to automate the execution of regression tests.
DOI 原文 ·
@inproceedings{paperbot4783,
title = {Achieving test automation with testers without coding skills: an industrial report},
author = {Davrondzhon Gafurov and Arne Erik Hurum and Martin Markman},
booktitle = {ASE},
year = {2018},
doi = {10.1145/3238147.3240463}
}