paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Making fair ML software using trustworthy explanation

使用可信解释构建公平的机器学习软件
ASE Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering2020匹配度 2/10 · 论文关注公平机器学习与黑盒解释,虽涉及 ML 软件但与用户核心方向(ML/Agent 程序的静态分析、LLM 改进静态分析/形式化验证、浮点程序分析、贝叶斯程序分析)几乎没有交集。引用 28 inbox
Joymallya Chakraborty, Kewen Peng, Tim Menzies
crossref: 2026-09-12

AI 速览

一句话:提出基于 K 近邻的可信解释方法,揭示黑盒 ML 模型的潜在偏见,弥补现有偏见度量与解释方法的不足。

机器学习软件广泛应用于金融、招聘、招生和刑事司法等具有重大社会影响的场景,但其预测可能基于性别、种族等敏感属性产生偏见与歧视。已有工作主要关注发现和缓解 ML 模型中的偏见,近期则用 LIME 等基于实例的模型无关解释方法检测预测偏见。本文指出现有偏见度量与解释方法存在不足,并提出一种基于 K 最近邻(KNN)的方法来克服这些不足,从而发现黑盒模型背后的潜在偏见。作者表示其结果更可信、对实践者更有帮助,并展望了一个结合解释与规划以构建公平软件的框架。

问题
现有 ML 偏见度量与基于实例的模型无关解释方法(如 LIME)在检测黑盒模型偏见时存在不足,难以可信地发现底层偏见。
方法
提出基于 K 最近邻(KNN)的方法来克服现有偏见度量与解释方法的缺陷,发现黑盒模型的潜在偏见,并展望结合解释与规划构建公平软件的框架。
评估
摘要未报告具体数据集或量化指标,仅声称所提方法的结果比现有方法更可信、对实践者更有帮助。
原文摘要(Abstract)

Machine learning software is being used in many applications (finance, hiring, admissions, criminal justice) having huge social impact. But sometimes the behavior of this software is biased and it shows discrimination based on some sensitive attributes such as sex, race etc. Prior works concentrated on finding and mitigating bias in ML models. A recent trend is using instance-based model-agnostic explanation methods such as LIME[36] to find out bias in the model prediction. Our work concentrates on finding shortcomings of current bias measures and explanation methods. We show how our proposed method based on K nearest neighbors can overcome those shortcomings and find the underlying bias of black box models. Our results are more trustworthy and helpful for the practitioners. Finally, We describe our future framework combining explanation and planning to build fair software.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot6025,
  title = {Making fair ML software using trustworthy explanation},
  author = {Joymallya Chakraborty and Kewen Peng and Tim Menzies},
  booktitle = {ASE},
  year = {2020},
  doi = {10.1145/3324884.3418932}
}