一句话：提出面向决策系统的参数扰动覆盖准则，并在自动驾驶路径规划器中验证其优于经典结构覆盖。
多准则决策分析等决策系统将决策过程建模为数学函数，其测试对安全攸关场景至关重要；但经典结构覆盖准则可能被仅覆盖单一决策类型的简单测试满足，无法充分触发各类决策。本文论证该类系统需要定制化覆盖准则，并提出基于系统参数扰动的覆盖准则。作者在自动驾驶路径规划系统上将其与经典结构覆盖准则对比，表明该准则能更有效地激发不同决策类型，并有助于在测试中解释决策产生的原因。
Decision systems such as Multiple-Criteria Decision Analysis systems formulate a decision process in terms of a mathematical function that takes into consideration different aspects of a problem. Testing such systems is crucial, as they are usually employed in safety-critical systems. A good test suite for these systems should be able to exercise all the possible types of decisions that can be taken by the system. Classic structural coverage criteria do not provide good test suites in this sense, as they can be fulfilled by simple tests that only cover one possible type of decision. Thus, in this paper we discuss the need for tailored coverage criteria for this class of systems, and we propose a criterion based on the perturbation of the decision systems’ parameters. We demonstrate the effectiveness of the criterion, compared to classic structural coverage criteria, on a path planner system for autonomous driving. We also discuss other benefits, such as the criterion helping explain why a decision was made during a test.
DOI 原文 ·
@inproceedings{paperbot6557,
title = {Shake Those System Parameters! On the Need for Parameter Coverage for Decision Systems},
author = {Thomas Laurent and Paolo Arcaini and Fuyuki Ishikawa and Anthony Ventresque},
booktitle = {ASE},
year = {2021},
doi = {10.1109/ase51524.2021.9678593}
}