一句话:提出由可证明公平的初始化与保公平训练算法组成的框架,在训练全程形式化保证个体公平性。
机器学习的个体公平性要求仅在敏感属性上不同的个体得到相同结果,但常用训练方法(如把公平约束加入优化目标)只有经验效果,缺乏形式保证;基于验证的方法可能给不出确定结论,也无法在训练中主动提升公平性。本文提出一个在训练全程提供形式化公平保证的框架,由两部分组成:可证明公平的初始化使模型从公平状态出发,保公平训练算法在模型学习过程中维持公平性。其核心是随机化应答机制,在保护敏感属性的同时维持公平保证,作者形式化证明了该机制在训练过程中持续保持个体公平。实验显示所得模型既公平又准确,且效率远高于需在训练中反复进行神经网络验证的 certified training 方法。
Fairness in machine learning is more important than ever as ethical concerns continue to grow. Individual fairness demands that individuals differing only in sensitive attributes receive the same outcomes. However, commonly used machine learning algorithms often fail to achieve such fairness. To improve individual fairness, various training methods have been developed, such as incorporating fairness constraints as optimisation objectives. While these methods have demonstrated empirical effectiveness, they lack formal guarantees of fairness. Existing approaches that aim to provide fairness guarantees primarily rely on verification techniques, which can sometimes fail to produce definitive results. Moreover, verification alone does not actively enhance individual fairness during training. To address this limitation, we propose a novel framework that formally guarantees individual fairness throughout training. Our approach consists of two parts, i.e., (1) provably fair initialisation that ensures the model starts in a fair state, and (2) a fairness-preserving training algorithm that maintains fairness as the model learns. A key element of our method is the use of randomised response mechanisms, which protect sensitive attributes while maintaining fairness guarantees. We formally prove that this mechanism sustains individual fairness throughout the training process. Experimental evaluations confirm that our approach is effective, i.e., producing models that are empirically fair and accurate. Furthermore, our approach is much more efficient than the alternative approach based on certified training (which requires neural network verification during training).
@article{paperbot3019,
title = {Correct-by-Construction: Certified Individual Fairness through Neural Network Training},
author = {Ruihan Zhang and Jun Sun},
journal = {Proceedings of the ACM on Programming Languages},
volume = {9},
number = {OOPSLA2},
year = {2025},
doi = {10.1145/3763107}
}