一句话:提出多目标搜索与用例最小化结合的CPS验收测试用例排序方法,在时间约束和硬件风险下优化测试。
针对信息物理系统(CPS)验收测试常在硬件在环、近实际环境中进行,且受时间预算、环境不确定性与硬件损伤风险制约的问题,本文提出一种自动化测试用例优先级排序方法。该方法将优先级排序建模为多目标搜索问题,并引入测试用例最小化算法,从已排序序列中消除冗余操作,以在有限时间内兼顾测试覆盖与降低关键硬件损坏风险。作者在卫星领域的代表性案例上评估,并与卫星工程师手工排序的用例比较。结果表明,自动化方法在给定时间框架内可纳入的测试用例数量增加一倍以上,同时使可能损坏关键硬件组件的操作数量降至不足原来的三分之一。
Acceptance testing validates that a system meets its requirements and determines whether it can be sufficiently trusted and put into operation. For cyber physical systems (CPS), acceptance testing is a hardware-in-the-loop process conducted in a (near-)operational environment. Acceptance testing of a CPS often necessitates that the test cases be prioritized, as there are usually too many scenarios to consider given time constraints. CPS acceptance testing is further complicated by the uncertainty in the environment and the impact of testing on hardware. We propose an automated test case prioritization approach for CPS acceptance testing, accounting for time budget constraints, uncertainty, and hardware damage risks. Our approach is based on multi-objective search, combined with a test case minimization algorithm that eliminates redundant operations from an ordered sequence of test cases. We evaluate our approach on a representative case study from the satellite domain. The results indicate that, compared to test cases that are prioritized manually by satellite engineers, our automated approach more than doubles the number of test cases that fit into a given time frame, while reducing to less than one third the number of operations that entail the risk of damage to key hardware components.
@inproceedings{paperbot4826,
title = {Test case prioritization for acceptance testing of cyber physical systems: a multi-objective search-based approach},
author = {Seung Yeob Shin and Shiva Nejati and Mehrdad Sabetzadeh and Lionel C. Briand and Frank Zimmer},
booktitle = {ISSTA},
year = {2018},
doi = {10.1145/3213846.3213852}
}