paperbot · PL 论文追踪

全部论文 待读 收藏

P1 Certified Continual Learning for Neural Network Regression

面向神经网络回归的认证持续学习
ISSTA Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis2024匹配度 5/10 · 论文处于机器学习与程序验证/形式化方法的交叉,关注神经网络再训练时保持已认证正确性,与用户对 ML 系统正确性及形式化验证的相邻兴趣相关;但它不涉及静态分析、LLM/Agent、浮点或贝叶斯程序分析等核心方向,因此匹配度中等。引用 2 inbox
Long H. Pham, Jun Sun
crossref: 2026-09-12

AI 速览

一句话:提出认证持续学习,在再训练神经网络时尽可能保持已认证的正确性,并兼顾效用。

神经网络验证近年取得进展,使网络正确性可被认证;但实际网络常因新数据分布或新任务而持续再训练,再训练可能破坏已验证性质,灾难性遗忘尤甚。本文提出“认证持续学习”,在采用现有持续学习方法更新回归网络时,尽量保留已验证的正确性属性。方法将认证约束融入持续学习过程,以在适应新数据的同时避免破坏已证明区域。作者在多个神经网络和两种持续学习方法上进行评估,结果显示该方法高效,训练后的模型能保持已认证的正确性,且通常维持较高效用。

问题
持续再训练会破坏神经网络已验证的正确性,尤其在灾难性遗忘存在时,如何在不牺牲适应能力的情况下保持认证性质。
方法
提出认证持续学习,将神经网络验证或认证目标与现有持续学习方法结合,在适配新数据时尽量保留已验证的正确性约束。
评估
在多个神经网络和两种持续学习方法上评估,考察方法效率、认证正确性的保持情况以及模型效用。
原文摘要(Abstract)

On the one hand, there has been considerable progress on neural network verification in recent years, which makes certifying neural networks a possibility. On the other hand, neural networks in practice are often re-trained over time to cope with new data distribution or for solving different tasks (a.k.a. continual learning). Once re-trained, the verified correctness of the neural network is likely broken, particularly in the presence of the phenomenon known as catastrophic forgetting. In this work, we propose an approach called certified continual learning which improves existing continual learning methods by preserving, as long as possible, the established correctness properties of a verified network. Our approach is evaluated with multiple neural networks and on two different continual learning methods. The results show that our approach is efficient and the trained models preserve their certified correctness and often maintain high utility.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot8548,
  title = {Certified Continual Learning for Neural Network Regression},
  author = {Long H. Pham and Jun Sun},
  booktitle = {ISSTA},
  year = {2024},
  doi = {10.1145/3650212.3680322}
}