一句话:提出 Themis,一个自动生成测试套件来度量软件歧视(含敏感输入与程序行为的因果关系)并辅助调试的工具。
现代软件系统在决策中可能表现出对特定群体的歧视(bias),这一问题日益普遍且严重,但缺乏自动化的检测与调试手段。本文提出 Themis——一个自动化的测试套件生成器,用于度量两类歧视,其中一类刻画敏感输入(如种族、性别)与程序行为之间的因果关系,从而判断程序是否因敏感属性而产生不同输出;Themis 同时支持对歧视问题的调试。为应对组合爆炸,Themis 采用了一系列优化来缩减测试套件规模,在保持检测能力的同时降低开销。作者在多个开源软件上验证了 Themis 的有效性。Themis 已开源,全部评估数据与演示视频均可公开获取。
Bias in decisions made by modern software is becoming a common and serious problem. We present Themis, an automated test suite generator to measure two types of discrimination, including causal relationships between sensitive inputs and program behavior. We explain how Themis can measure discrimination and aid its debugging, describe a set of optimizations Themis uses to reduce test suite size, and demonstrate Themis' effectiveness on open-source software. Themis is open-source and all our evaluation data are available at http://fairness.cs.umass.edu/. See a video of Themis in action: https://youtu.be/brB8wkaUesY