paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Fairway: a way to build fair ML software

Fairway:构建公平机器学习软件的一种方法
FSE Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering2020匹配度 2/10 · 论文关注机器学习软件中的公平性/偏见检测与缓解,属于ML软件工程与测试方向,但与用户核心方向(静态分析、LLM/Agentic程序分析、浮点或贝叶斯程序分析及其与LLM交叉)几乎没有直接关联,也未涉及程序语言形式化或工业静态分析工具。引用 127 inbox
Joymallya Chakraborty, Suvodeep Majumder, Zhe Yu, Tim Menzies
crossref: 2026-09-12

AI 速览

一句话:提出 Fairway,结合预处理与处理中方法检测并缓解训练数据和模型中的伦理偏差,且尽量不损害预测性能。

机器学习软件日益用于影响人们生活的决策,但学习模型可能对特定群体(如性别、种族等)表现出算法歧视或伦理偏差。已有工作关注偏差检测,而检测后的偏差缓解同样关键。本文首先解释训练数据中的真实偏差如何影响模型公平性,以及如何在 AI 软件中发现该偏差;随后提出 Fairway,结合预处理与处理中方法,从训练数据和已训练模型中移除伦理偏差。结果表明,该方法能够在发现并缓解模型偏差的同时,不显著损害模型的预测性能。作者主张将偏差测试与偏差缓解作为机器学习软件开发生命周期中的常规环节,Fairway 为这两个目的提供了支持。

问题
如何发现并缓解 AI/ML 软件中由训练数据真实偏差导致的模型伦理偏差,同时尽量保持预测性能。
方法
提出 Fairway,结合预处理与处理中方法来移除训练数据与已训练模型中的伦理偏差,并支持偏差测试与缓解流程。
评估
通过实验评估偏差发现与缓解效果及其对预测性能的影响,结果显示可在不过多损害预测性能的情况下缓解模型偏差。
原文摘要(Abstract)

Machine learning software is increasingly being used to make decisions that affect people's lives. But sometimes, the core part of this software (the learned model), behaves in a biased manner that gives undue advantages to a specific group of people (where those groups are determined by sex, race, etc.). This "algorithmic discrimination" in the AI software systems has become a matter of serious concern in the machine learning and software engineering community. There have been works done to find "algorithmic bias" or "ethical bias" in the software system. Once the bias is detected in the AI software system, the mitigation of bias is extremely important. In this work, we a)explain how ground-truth bias in training data affects machine learning model fairness and how to find that bias in AI software,b)propose a method Fairway which combines pre-processing and in-processing approach to remove ethical bias from training data and trained model. Our results show that we can find bias and mitigate bias in a learned model, without much damaging the predictive performance of that model. We propose that (1) testing for bias and (2) bias mitigation should be a routine part of the machine learning software development life cycle. Fairway offers much support for these two purposes.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot5724,
  title = {Fairway: a way to build fair ML software},
  author = {Joymallya Chakraborty and Suvodeep Majumder and Zhe Yu and Tim Menzies},
  booktitle = {FSE},
  year = {2020},
  doi = {10.1145/3368089.3409697}
}