一句话:提出 Fairway,结合预处理与处理中方法检测并缓解训练数据和模型中的伦理偏差,且尽量不损害预测性能。
机器学习软件日益用于影响人们生活的决策,但学习模型可能对特定群体(如性别、种族等)表现出算法歧视或伦理偏差。已有工作关注偏差检测,而检测后的偏差缓解同样关键。本文首先解释训练数据中的真实偏差如何影响模型公平性,以及如何在 AI 软件中发现该偏差;随后提出 Fairway,结合预处理与处理中方法,从训练数据和已训练模型中移除伦理偏差。结果表明,该方法能够在发现并缓解模型偏差的同时,不显著损害模型的预测性能。作者主张将偏差测试与偏差缓解作为机器学习软件开发生命周期中的常规环节,Fairway 为这两个目的提供了支持。
Machine learning software is increasingly being used to make decisions that affect people's lives. But sometimes, the core part of this software (the learned model), behaves in a biased manner that gives undue advantages to a specific group of people (where those groups are determined by sex, race, etc.). This "algorithmic discrimination" in the AI software systems has become a matter of serious concern in the machine learning and software engineering community. There have been works done to find "algorithmic bias" or "ethical bias" in the software system. Once the bias is detected in the AI software system, the mitigation of bias is extremely important. In this work, we a)explain how ground-truth bias in training data affects machine learning model fairness and how to find that bias in AI software,b)propose a method Fairway which combines pre-processing and in-processing approach to remove ethical bias from training data and trained model. Our results show that we can find bias and mitigate bias in a learned model, without much damaging the predictive performance of that model. We propose that (1) testing for bias and (2) bias mitigation should be a routine part of the machine learning software development life cycle. Fairway offers much support for these two purposes.