一句话:提出工具 GAssertMRs,用遗传编程自动生成蜕变关系,在电梯工业案例中优于人工基线。
复杂工业信息物理系统验证中的一大难题是测试预言问题:难以判断系统输出或行为是否正确。蜕变测试通过检查多次执行之间应满足的蜕变关系(MR)来缓解该问题,但有效 MR 通常依赖领域专家手工开发。本文开展案例研究,旨在自动化这一过程,实现了基于遗传编程自动生成 MR 的工具 GAssertMRs。作者在电梯领域的工业案例中评估其成本效益,并与多种基线(包括领域专家手工生成的 MR)比较。实验结果表明,GAssertMRs 在大多数情况下优于其他基线,包括人工 MR。文中还总结了经验教训,并展望该技术被工业实践者采用的未来工作。
One of the major challenges in the verification of complex industrial Cyber-Physical Systems is the difficulty of determining whether a particular system output or behaviour is correct or not, the so-called test oracle problem. Metamorphic testing alleviates the oracle problem by reasoning on the relations that are expected to hold among multiple executions of the system under test, which are known as Metamorphic Relations (MRs). However, the development of effective MRs is often challenging and requires the involvement of domain experts. In this paper, we present a case study aiming at automating this process. To this end, we implemented GAssertMRs, a tool to automatically generate MRs with genetic programming. We assess the cost-effectiveness of this tool in the context of an industrial case study from the elevation domain. Our experimental results show that in most cases GAssertMRs outperforms the other baselines, including manually generated MRs developed with the help of domain experts. We then describe the lessons learned from our experiments and we outline the future work for the adoption of this technique by industrial practitioners.
@inproceedings{paperbot6292,
title = {Generating metamorphic relations for cyber-physical systems with genetic programming: an industrial case study},
author = {Jon Ayerdi and Valerio Terragni and Aitor Arrieta and Paolo Tonella and Goiuria Sagardui and Maite Arratibel},
booktitle = {FSE},
year = {2021},
doi = {10.1145/3468264.3473920}
}