paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Test Script Repair of Deep Learning Library Testing

深度学习库测试的测试脚本修复
FSE Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering2025匹配度 3/10 · 论文用LLM修复深度学习库测试脚本中的无效模型,属于ML与PL交叉的测试/修复,但与用户核心关注的静态分析、Agentic程序分析、浮点/贝叶斯程序分析及其LLM交叉均无直接关系;仅与“LLM作为工具改进PL任务”有边缘关联。引用 0 inbox
Xing Fu
crossref: 2026-09-12

AI 速览

一句话:利用LLM与结构化提示自动修复深度学习库测试脚本中的无效模型。

深度学习库(如TensorFlow、PyTorch)的测试脚本常因库版本演进或测试方法自身缺陷而包含无效模型,严重影响测试效率;由于DL模型结构复杂,人工修复这些模型十分困难。本文提出一种基于大语言模型(LLM)的专用提示(prompt)策略,通过向LLM提供结构化的错误信息与模型配置,引导其生成修复无效模型的代码。实验结果显示,该策略能成功修复大多数无效模型,并有助于发现DL库测试方法中的缺陷以及版本更新导致的问题,从而提升DL模型的鲁棒性和可迁移性。

问题
深度学习库测试中,库版本演进和测试方法缺陷会产生无效模型,严重影响测试效率,而人工修复因模型复杂而困难。
方法
提出一种基于大语言模型的专用提示策略,将结构化的错误信息和模型配置提供给LLM,让其生成代码来修复无效模型。
评估
实验表明大多数无效模型可以被该策略成功修复,同时该方法还能帮助发现DL库测试方法的缺陷以及版本更新引发的问题。
原文摘要(Abstract)

Deep learning (DL) libraries such as TensorFlow and PyTorch are widely utilized to develop machine learning models. However, when testing DL libraries, evolving library versions and flaws of testing approaches may result in invalid models within test scripts, which influence testing efficiency severely. Repairing these models can be difficult to achieve manually because of the complexity of DL models. In this paper, we propose a novel approach that utilizes a specialized prompt-based strategy with Large Language Model (LLM) to repair invalid DL models. We manually provide structured error information and model configurations to LLM, allowing it to generate code to fix invalid models. Our work shows that most invalid models can be repaired successfully with our strategy. Moreover, our approach can help to detect flaws in the DL library testing approaches and issues caused by version updates, which enhances the robustness and transferability of DL models.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot9057,
  title = {Test Script Repair of Deep Learning Library Testing},
  author = {Xing Fu},
  booktitle = {FSE},
  year = {2025},
  doi = {10.1145/3696630.3728616}
}