一句话:提出首个面向深度神经网络的Concolic测试方法,以线性算术表达测试需求,提升覆盖率并发现对抗样本。
深度神经网络的可靠性测试日益重要,但如何系统探索其行为并提高覆盖率仍具挑战。本文将软件测试中的Concolic测试(结合具体执行与符号分析)引入DNN,提出首个面向DNN的Concolic测试方法。方法用有理数上的量词线性算术表达已有文献中的测试需求,并设计统一流程在DNN上执行Concolic测试,以提升覆盖率。实验表明,该方法既能取得较高覆盖率,也能有效发现对抗样本,证明了Concolic测试在DNN测试中的有效性。
Concolic testing combines program execution and symbolic analysis to explore the execution paths of a software program. In this paper, we develop the first concolic testing approach for Deep Neural Networks (DNNs). More specifically, we utilise quantified linear arithmetic over rationals to express test requirements that have been studied in the literature, and then develop a coherent method to perform concolic testing with the aim of better coverage. Our experimental results show the effectiveness of the concolic testing approach in both achieving high coverage and finding adversarial examples.