一句话:提出 FairRF,用多目标进化搜索联合优化随机森林的超参数与数据变异,返回 Pareto 最优解集供权衡公平性与有效性。
AI/ML 系统在敏感领域的广泛部署引发公平性担忧,但现有公平性增强方法多为黑盒,不允许利益相关者根据自身需求在公平性与有效性(预测正确性)之间进行权衡。本文提出 FairRF,一种基于多目标进化搜索的方法,用于在分类任务中同时优化公平性与有效性:它以随机森林(RF)作为基础分类器,搜索最佳超参数配置与数据变异,最终返回一组 Pareto 最优解,由最终利益相关者按需选择。作者在 11 个场景下、针对 26 个基线方法进行了大规模实证评估,采用 5 个有效性指标与 3 个公平性指标,并额外加入公平性指标的两个交叉偏差变体,共分析 6 种定义。结果表明,FairRF 能在保持预测有效性基本不变的前提下显著提升基础分类器的公平性,在所有公平性定义下比当前最先进的偏差缓解方法优化更一致,并在交叉偏差缓解上超越了现有方法。
Background: The wide adoption of AI- and ML-based systems in sensitive domains raises severe concerns about their fairness. Many methods have been proposed in the literature to enhance software fairness. However, the majority behave as a black-box, not allowing stakeholders to prioritise fairness or effectiveness (i.e., prediction correctness) based on their needs. Aims: In this paper, we introduce FairRF, a novel approach based on multi-objective evolutionary search to optimise fairness and effectiveness in classification tasks. FairRF uses a Random Forest (RF) model as a base classifier and searches for the best hyperparameter configurations and data mutation to maximise fairness and effectiveness. Eventually, it returns a set of Pareto optimal solutions, allowing the final stakeholders to choose the best one based on their needs. Method: We conduct an extensive empirical evaluation of FairRF against 26 different baselines in 11 different scenarios using five effectiveness and three fairness metrics. Additionally, we also include two variations of the fairness metrics for intersectional bias for a total of six definitions analysed. Result: Our results show that FairRF can significantly improve the fairness of base classifiers, while maintaining consistent prediction effectiveness. Additionally, FairRF provides a more consistent optimisation under all fairness definitions compared to state-of-the-art bias mitigation methods and overcomes the existing state-of-the-art approach for intersectional bias mitigation. Conclusions: FairRF is an effective approach for bias mitigation also allowing stakeholders to adapt the development of fair software systems based on their specific needs.
@inproceedings{paperbot12058,
title = {FairRF: Multi-Objective Search for Single and Intersectional Software Fairness},
author = {Giordano d’Aloisio and Max Hort and Rebecca Moussa and Federica Sarro},
booktitle = {ICSE},
year = {2026},
doi = {10.1145/3786581.3786922}
}