paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Towards Reliable Testing of Machine Unlearning

迈向可靠的机器遗忘测试
FSE Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering2026匹配度 3/10 · 论文属于机器学习与软件工程交叉的测试/调试问题,与程序语言和测试思维有一定关联,但其核心是machine unlearning的因果模糊测试,不涉及用户主线的静态分析、LLM/Agent、浮点程序分析或贝叶斯程序分析。引用 0 inbox
Anna Mazhar, Sainyam Galhotra
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:将机器遗忘测试视为首要软件工程问题,提出因果模糊测试来检测并定位模型残余影响。

随着法规要求从已部署模型中删除敏感数据,机器遗忘成为替代完全重训练的实际方案,但也带来软件质量保证挑战:在真实部署约束与不完美 oracle 下,如何测试模型不再依赖被删除的定向信息?本文将遗忘测试界定为一等软件工程问题,提出实用测试须满足四点:覆盖代理与中介影响路径、提供可调试且能定位泄漏持续位置的诊断、在查询预算下进行低成本回归式执行、以及面向 API 模型的黑盒适用性。作者给出以因果和路径为中心的视角——因果模糊测试,通过生成受预算约束的干预来估计残余的直接与间接效应,并产生可操作的“泄漏报告”。概念验证结果表明,标准归因检查会因代理路径、抵消效应和子群掩蔽而漏掉残余影响,从而支持因果测试作为遗忘测试的有前景方向。

问题
在真实部署约束和不完美 oracle 下,如何可靠地测试机器遗忘后的模型确实不再依赖被删除的定向信息。
方法
将遗忘测试形式化为软件工程问题,提出因果模糊测试:生成受查询预算约束的干预,估计残余直接与间接影响,并输出可定位泄漏的诊断报告。
评估
通过概念验证实验展示标准归因检查会因代理路径、抵消效应和子群掩蔽而遗漏残余影响,以此论证因果测试方向的必要性。
原文摘要(Abstract)

Machine learning components are now central to AI-infused software systems, from recommendations and code assistants to clinical decision support. As regulations and governance frameworks increasingly require deleting sensitive data from deployed models, machine unlearning is emerging as a practical alternative to full retraining. However, unlearning introduces a software quality-assurance challenge: under realistic deployment constraints and imperfect oracles, how can we test that a model no longer relies on targeted information? This paper frames unlearning testing as a first-class software engineering problem. We argue that practical unlearning tests must provide (i) thorough coverage over proxy and mediated influence pathways, (ii) debuggable diagnostics that localize where leakage persists, (iii) cost-effective regression-style execution under query budgets, and (iv) black-box applicability for API-deployed models. We outline a causal, pathway-centric perspective, causal fuzzing, that generates budgeted interventions to estimate residual direct and indirect effects and produce actionable "leakage reports". Proof-of-concept results illustrate that standard attribution checks can miss residual influence due to proxy pathways, cancellation effects, and subgroup masking, motivating causal testing as a promising direction for unlearning testing.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{abs-2604-16536,
  title = {Towards Reliable Testing of Machine Unlearning},
  author = {Anna Mazhar and Sainyam Galhotra},
  booktitle = {FSE},
  year = {2026},
  doi = {10.1145/3803437.3805557}
}