paperbot · PL 论文追踪

全部论文 待读 收藏

P2 APIDA-Chat: Structured Synthesis of API Search Dialogues to Bootstrap Conversational Agents

APIDA-Chat:结构化合成 API 搜索对话以引导对话式智能体
ASE 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE)2025匹配度 2/10 · 论文聚焦于用教师-学生蒸馏合成 API 搜索对话,以引导对话式智能体,属于 LLM/Agent 能力构建与开发者工具方向,而非用户关注的静态分析、形式化验证、浮点程序分析或贝叶斯程序分析。其研究目标更接近提升 LLM/对话智能体自身能力,与画像中“LLM 作为工具服务于 PL/静态分析”的核心方向不匹配。引用 0 inbox
Zachary Eberhart, Collin McMillan
crossref: 2026-09-12

AI 速览

一句话:APIDA-Chat 用教师-学生蒸馏把符号对话脚本转成真实 API 搜索对话,低成本引导对话式智能体。

大语言模型助手擅长讲解流行 API,但在小众或专有库上表现不佳,因为多轮对话微调数据稀缺。本文提出 APIDA-Chat,一个开源流水线,将符号化对话行为脚本转换为真实、领域落地的 API 搜索对话。第一阶段用传统对话规划器配合高能力教师 LLM(o4-mini)合成金标准对话,并微调 Llama 3.2 3B 学生模型;第二阶段去掉教师,复用同一规划器与微调模型,实现低成本快速合成新对话且不将源码暴露给外部服务。评估显示,微调学生模型相比基座 BLEU 从 0.38 提升至 0.50,BERTScore 从 0.88 提升至 0.91,且完全可在单张消费级 GPU 上运行。所有组件模块化并公开,作为未来工作的保守基线。

问题
LLM 助手难以应对小众或专有 API,因为多轮对话微调数据稀缺,且直接使用外部服务可能泄露源码。
方法
提出 APIDA-Chat 流水线:将符号化对话行为脚本经规划器与教师 LLM 合成为领域落地的 API 搜索对话,用其微调轻量学生模型,再以学生模型替代教师进行低成本合成。
评估
在单张消费级 GPU 上对比基座与学生模型,BLEU 从 0.38 升至 0.50,BERTScore 从 0.88 升至 0.91,并开源全部模块与演示。
原文摘要(Abstract)

Large-language-model assistants are suitable for explaining popular APIs, yet they falter on niche or proprietary libraries because the multi-turn dialogue data needed for fine-tuning are scarce. We present APIDA-Chat, an open-source pipeline that converts symbolic dialogue-act "scripts" into realistic, domain-grounded API Search conversations using a lightweight model for inexpensive training data generation. Phase I pairs a legacy dialogue planner with a high-capability teacher LLM (o4-mini) to synthesize a "gold set" of realized dialogues; then, a smaller Llama 3.2 3B student model is fine-tuned on this corpus. Phase II drops the teacher and reuses the same planner with the fine-tuned model, allowing rapid, low-cost synthesis of new dialogues without exposing source code to external services. The fine-tuned student improves BLEU from 0.38 to 0.50 and BERTScore from 0.88 to 0.91 versus the base model while running entirely on a single consumer GPU. All components are modular and publicly released to serve as a conservative baseline for future work. APIDA-Chat is open-sourced at https://github.com/Zeberhart/apida-chat and a video demo is available at https://youtu.be/YqmZBHyGbPs.

链接与引用

DOI 原文 ·

BibTeX
@inproceedings{paperbot9209,
  title = {APIDA-Chat: Structured Synthesis of API Search Dialogues to Bootstrap Conversational Agents},
  author = {Zachary Eberhart and Collin McMillan},
  booktitle = {ASE},
  year = {2025},
  doi = {10.1109/ase63991.2025.00382}
}