paperbot · PL 论文追踪

全部论文 待读 收藏

P2 SEER: Enhancing Chain-of-Thought Code Generation through Self-Exploring Deep Reasoning

SEER:通过自探索深度推理增强思维链代码生成
ICSE Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering2026匹配度 2/10 · 该论文聚焦于通过自探索推理和训练提升LLM的思维链代码生成质量,本质是改进LLM自身能力,而非将静态分析应用于ML/Agentic程序,也非用LLM改进静态分析或形式化验证;与浮点/贝叶斯程序分析等方向无直接关联。引用 1 inbox
Shuzheng Gao, Chaozheng Wang, Cuiyun Gao, Michael R. Lyu
crossref: 2026-09-12

AI 速览

一句话:将思维链代码生成建模为决策问题,用自探索推理路径、质量感知训练与自适应推理提升生成质量。

论文针对大语言模型在代码生成中思维链(CoT)推理的三个局限:推理路径探索单一导致泛化不足、中间推理步骤缺乏质量评估、以及“过度思考”可能带来不必要地复杂甚至错误的解。作者将 CoT 代码生成形式化为决策问题,提出自探索深度推理框架 SEER,包含三个组件:(1) 多样推理路径探索,在无需人工专家或闭源专有模型的情况下探索多样推理路径并标注中间步骤;(2) 推理质量感知的模型训练,训练策略模型生成候选推理步骤、价值模型评估其质量;(3) 自适应 CoT 推理,针对不同问题在直接生成与逐步推理之间动态切换,从而实现准确且自适应的代码生成推理。

问题
现有 CoT 代码生成方法存在三方面不足:推理路径探索有限导致跨编程场景泛化差、中间推理步骤缺乏质量评估、以及“过度思考”可能产生复杂而错误的解。
方法
把 CoT 代码生成建模为决策问题,自探索多样推理路径并标注中间步骤,训练策略模型生成候选推理步骤、价值模型评估其质量,并自适应地在直接生成与逐步推理间切换。
评估
摘要未给出具体实验设置与结果,仅说明该框架旨在实现准确且自适应的代码生成推理。
原文摘要(Abstract)

Code generation, the task of creating executable programs from natural language requirements, has recently seen tremendous advances through Chain-of-Thought (CoT) reasoning, which enables Large Language Models (LLMs) to develop high-level reasoning plans before writing code. Recent research has proposed various methods to enhance models' CoT reasoning for code generation such as prompt engineering and supervised fine-tuning. However, existing approaches still face three critical limitations: (1) limited exploration of diverse reasoning paths, which constrains generalization across various programming scenarios, (2) lack of quality assessment for intermediate reasoning steps, which hampers the reliability of the generated plans and code, and (3) the potential negative impact of "overthinking", potentially leading to unnecessarily complex and incorrect solutions. To address these limitations, we frame CoT code generation as a decision making problem and present SEER, a SElf-Exploring deep Reasoning framework that enables accurate and adaptive reasoning for code generation. SEER introduces three key components: (1) Diverse reasoning path exploration, which aims at exploring diverse reasoning paths and annotating intermediate steps without relying on manual experts or closed-source proprietary models; (2) Reasoning quality-aware model training, which trains a policy model for generating candidate reasoning steps and a value model for assessing their quality; and (3) Adaptive CoT reasoning, which dynamically switches between direct generation and step-by-step reasoning for different problems.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot11762,
  title = {SEER: Enhancing Chain-of-Thought Code Generation through Self-Exploring Deep Reasoning},
  author = {Shuzheng Gao and Chaozheng Wang and Cuiyun Gao and Michael R. Lyu},
  booktitle = {ICSE},
  year = {2026},
  doi = {10.1145/3744916.3773197}
}