paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Efficient white-box fairness testing through gradient search

基于梯度搜索的高效白盒公平性测试
ISSTA Proceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis2021匹配度 2/10 · 该论文研究深度学习模型的公平性测试,使用梯度搜索生成个体歧视样本,属于传统软件测试与ML测试方向;与用户关注的静态分析、Agentic程序、浮点程序分析、贝叶斯程序分析及LLM交叉均无直接关联。引用 56 inbox
Lingfeng Zhang, Yueling Zhang, Min Zhang
crossref: 2026-09-12

AI 速览

一句话:提出框架 EIDIG,用全局种子生成加梯度引导的局部搜索,高效发现深度学习模型的个体歧视实例。

深度学习系统广泛用于自动决策,公平性是其重要属性。为评估与提升模型的个体公平性,需在输入空间中系统生成测试用例以识别个体歧视样本。本文提出白盒测试框架 EIDIG:全局生成阶段快速产生一组多样化的歧视种子,局部生成阶段则在模型输出梯度引导下围绕这些种子生成尽可能多的个体歧视实例;两个阶段均充分利用迭代中的先验信息,以加速优化收敛或减少梯度计算。实验表明,与当前最优方法相比,EIDIG 平均多生成 19.11% 的个体歧视实例,速度提升 121.49%;重训练后个体歧视减少 80.03%,且精度损失有限。

问题
如何为深度学习模型高效地系统生成测试用例,以发现输入空间中的个体歧视实例并评估其个体公平性。
方法
提出 EIDIG 框架,先用全局生成阶段产生多样化歧视种子,再在模型输出梯度引导下进行局部生成,并复用相邻迭代的先验信息加速收敛与减少梯度计算。
评估
在深度学习模型上与当前最优方法对比,统计生成的个体歧视实例数量与耗时,并通过重训练考察歧视缓解效果与精度损失。
原文摘要(Abstract)

Deep learning (DL) systems are increasingly deployed for autonomous decision-making in a wide range of applications. Apart from the robustness and safety, fairness is also an important property that a well-designed DL system should have. To evaluate and improve individual fairness of a model, systematic test case generation for identifying individual discriminatory instances in the input space is essential. In this paper, we propose a framework EIDIG for efficiently discovering individual fairness violation. Our technique combines a global generation phase for rapidly generating a set of diverse discriminatory seeds with a local generation phase for generating as many individual discriminatory instances as possible around these seeds under the guidance of the gradient of the model output. In each phase, prior information at successive iterations is fully exploited to accelerate convergence of iterative optimization or reduce frequency of gradient calculation. Our experimental results show that, on average, our approach EIDIG generates 19.11% more individual discriminatory instances with a speedup of 121.49% when compared with the state-of-the-art method and mitigates individual discrimination by 80.03% with a limited accuracy loss after retraining.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot6689,
  title = {Efficient white-box fairness testing through gradient search},
  author = {Lingfeng Zhang and Yueling Zhang and Min Zhang},
  booktitle = {ISSTA},
  year = {2021},
  doi = {10.1145/3460319.3464820}
}