paperbot · PL 论文追踪

全部论文 待读 收藏

P1 Agentic Code Review in the Terminal: A Trajectory-Level Analysis of Behavior, Cost, and Human-Alignment

终端中的智能体代码评审:行为、成本与人类对齐的轨迹级分析
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026匹配度 5/10 · 论文聚焦终端 Coding Agent 的代码评审轨迹、隐藏成本与人类对齐,与画像中关注的 Agentic 程序/Coding Agent 及其评估问题相邻;但它并未涉及静态分析在 Agentic 程序中的应用,也不涉及浮点或贝叶斯程序分析,且研究目标更偏 LLM/Agent 行为本身,因此属于外围相关而非核心匹配。引用 1 inbox
Wachiraphan Charoenwet, Kla Tantithamthavorn, Patanamon Thongtanunam, Hong Yi Lin, Minwoo Jeong, Ming Wu
crossref: 2026-10-09

AI 速览

一句话:以轨迹级分析刻画终端智能体代码评审的行为模式、隐藏成本与人类对齐情况。

基于终端的智能体代码评审可在本地开发阶段、创建 pull request 之前提供早期反馈。然而现有评估多以性能指标为中心,未能刻画扎根于代码仓库的智能体评审员的动态行为,因而难以理解其成功、失败以及在实践中产生的隐藏运行成本。本文转而以评审智能体的执行轨迹为分析对象,对其行为进行轨迹级研究。结果显示:智能体评审员虽然取得更高的评审精度,但付出了可观的探索与验证开销;成功的评审往往与更强的规划行为以及更少的下游验证相关联。作者据此指出,未来智能体代码评审系统有必要采用轨迹感知与成本敏感的评价方式。

问题
现有对终端智能体代码评审的评估以性能为中心,无法刻画其动态行为与隐藏的运行成本,难以解释智能体在实践中如何成功或失败。
方法
以仓库为依托的智能体评审员为对象,采集并分析其执行轨迹,从行为、成本与人类对齐等维度进行轨迹级分析。
评估
通过轨迹分析报告评审精度、探索与验证开销,并考察规划强度与下游验证同评审成功之间的关联,据此提出轨迹感知与成本敏感的评价思路。
原文摘要(Abstract)

Agentic code review in terminal-based environments enables early feedback during local development before pull request creation. However, existing evaluations remain performance-centric and fail to capture the dynamic behaviors of repository-grounded agentic reviewers. Understanding these behaviors is critical for identifying how agentic reviewers succeed, fail, and incur hidden operational costs in practice. Then, we analyze the reviewers’ behavior based on their trajectories. Our results show that agentic reviewers achieve higher review precision but incur substantial exploration and validation overhead, while successful reviews are associated with stronger planning and less downstream validation. These findings highlight the potential benefits of trajectory-aware and cost-sensitive evaluation of future agentic code review systems.

链接与引用

DOI 原文 · arXiv · DBLP

BibTeX
@inproceedings{abs-2607-16740,
  title = {Agentic Code Review in the Terminal: A Trajectory-Level Analysis of Behavior, Cost, and Human-Alignment},
  author = {Wachiraphan Charoenwet and Kla Tantithamthavorn and Patanamon Thongtanunam and Hong Yi Lin and Minwoo Jeong and Ming Wu},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3834546}
}