paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Boosting the Revealing of Detected Violations in Deep Learning Testing: A Diversity-Guided Method

提升深度学习测试中已检测违规的揭示:一种多样性引导方法
ASE Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering2022匹配度 2/10 · 论文关注深度学习蜕变测试的用例优先级排序,属于动态测试而非静态分析,且未涉及LLM/Agent、浮点程序分析或贝叶斯程序分析,与用户研究画像核心方向匹配度低。引用 16 inbox
Xiaoyuan Xie, Pengbo Yin, Songqiang Chen
crossref: 2026-09-12

AI 速览

一句话:提出首个深度学习蜕变测试用例对优先级排序方法,用神经元输出分布差异度量多样性,加速违规暴露。

由于能够绕过 oracle 问题,蜕变测试(MT)已成为深度学习(DL)软件测试的常用技术。然而,现有工作尚未关注蜕变测试用例对(MP)的优先级排序,而这对于提升 DL 测试中 MT 的有效性十分关键。若故障敏感的 MP 未能优先执行,已检测违规的揭示可能被大幅延迟甚至遗漏,从而掩盖关键缺陷。本文提出首个面向 DL 软件的 MP 优先级排序方法,以促进 DL 测试中已检测违规的揭示。具体地,作者基于神经元输出的分布差异设计了一种新的度量,用于衡量 DL 软件在 MP 上的执行多样性,并据此优先排序故障敏感 MP。综合评估结果表明,所提出的优先级排序方法和多样性度量能有效优先故障敏感 MP、提升已检测违规的揭示,甚至有助于为图像分类 DL 软件选择和设计有效的蜕变关系。

问题
在深度学习软件蜕变测试中,蜕变测试用例对(MP)的优先级排序尚未被研究;若故障敏感 MP 不被优先执行,已检测违规的暴露会被延迟甚至遗漏,关键缺陷可能被掩盖。
方法
提出首个面向深度学习软件的 MP 优先级排序方法,基于神经元输出的分布差异定义执行多样性度量,并利用该度量优先排序故障敏感 MP。
评估
在图像分类深度学习软件上进行综合评估,结果表明该方法与多样性度量能有效优先故障敏感 MP、提升违规暴露,并有助于选择和设计有效的蜕变关系。
原文摘要(Abstract)

Due to the ability to bypass the oracle problem, Metamorphic Testing (MT) has been a popular technique to test deep learning (DL) software. However, no work has taken notice of the prioritization for Metamorphic test case Pairs (MPs), which is quite essential and beneficial to the effectiveness of MT in DL testing. When the fault-sensitive MPs apt to trigger violations and expose defects are not prioritized, the revealing of some detected violations can be greatly delayed or even missed to conceal critical defects. In this paper, we propose the first method to prioritize the MPs for DL software, so as to boost the revealing of detected violations in DL testing. Specifically, we devise a new type of metric to measure the execution diversity of DL software on MPs based on the distribution discrepancy of the neuron outputs. The fault-sensitive MPs are next prioritized based on the devised diversity metric. Comprehensive evaluation results show that the proposed prioritization method and diversity metric can effectively prioritize the fault-sensitive MPs, boost the revealing of detected violations, and even facilitate the selection and design of the effective Metamorphic Relations for the image classification DL software.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot7262,
  title = {Boosting the Revealing of Detected Violations in Deep Learning Testing: A Diversity-Guided Method},
  author = {Xiaoyuan Xie and Pengbo Yin and Songqiang Chen},
  booktitle = {ASE},
  year = {2022},
  doi = {10.1145/3551349.3556919}
}