一句话:将机器遗忘测试视为首要软件工程问题,提出因果模糊测试来检测并定位模型残余影响。
随着法规要求从已部署模型中删除敏感数据,机器遗忘成为替代完全重训练的实际方案,但也带来软件质量保证挑战:在真实部署约束与不完美 oracle 下,如何测试模型不再依赖被删除的定向信息?本文将遗忘测试界定为一等软件工程问题,提出实用测试须满足四点:覆盖代理与中介影响路径、提供可调试且能定位泄漏持续位置的诊断、在查询预算下进行低成本回归式执行、以及面向 API 模型的黑盒适用性。作者给出以因果和路径为中心的视角——因果模糊测试,通过生成受预算约束的干预来估计残余的直接与间接效应,并产生可操作的“泄漏报告”。概念验证结果表明,标准归因检查会因代理路径、抵消效应和子群掩蔽而漏掉残余影响,从而支持因果测试作为遗忘测试的有前景方向。
Machine learning components are now central to AI-infused software systems, from recommendations and code assistants to clinical decision support. As regulations and governance frameworks increasingly require deleting sensitive data from deployed models, machine unlearning is emerging as a practical alternative to full retraining. However, unlearning introduces a software quality-assurance challenge: under realistic deployment constraints and imperfect oracles, how can we test that a model no longer relies on targeted information? This paper frames unlearning testing as a first-class software engineering problem. We argue that practical unlearning tests must provide (i) thorough coverage over proxy and mediated influence pathways, (ii) debuggable diagnostics that localize where leakage persists, (iii) cost-effective regression-style execution under query budgets, and (iv) black-box applicability for API-deployed models. We outline a causal, pathway-centric perspective, causal fuzzing, that generates budgeted interventions to estimate residual direct and indirect effects and produce actionable "leakage reports". Proof-of-concept results illustrate that standard attribution checks can miss residual influence due to proxy pathways, cancellation effects, and subgroup masking, motivating causal testing as a promising direction for unlearning testing.