paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Back to the Basics: Rethinking Issue-Commit Linking with LLM-Assisted Retrieval

回归基础:用LLM辅助检索重新思考Issue-Commit链接
ICSE Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering2026匹配度 2/10 · 该论文研究的是软件维护中的 issue-commit 链接恢复,属于软件工程/挖掘软件仓库领域,与用户核心关注的静态分析、形式化验证、浮点程序分析、贝叶斯程序分析均无直接关联。虽然使用了 LLM 作为重排序工具并提出了更现实的评测设定,但应用场景偏离用户研究方向。引用 7 inbox
Huihui Huang, Ratnadira Widyasari, Ting Zhang, Ivana Clairine Irsan, Jieke Shi, Han Wei Ang, Frank Liauw, Eng Lieh Ouh, Lwin Khin Shar, Hong Jin Kang, David Lo
crossref: 2026-09-12

AI 速览

一句话:提出现实评测设定RDS,发现深度学习不如传统IR,并用向量检索与LLM重排实现EasyLink。

Issue-commit链接对软件维护至关重要,但现有评测忽略了仓库中大量相似无关提交的干扰。作者提出Realistic Distribution Setting(RDS),构建含20个开源项目的现实评测数据集。结果显示,最先进深度学习方法性能下降超一半,传统VSM反而更优。受此启发,作者提出EasyLink:以向量数据库进行现代信息检索,并用大语言模型对检索到的提交重排序,以缓解issue与commit的语义鸿沟。评测中EasyLink平均Precision@1达75.03%,较最先进方法提升四倍以上。论文还给出推进该方向研究的实践指南。

问题
现有issue-commit链接评测未考虑现实中仓库提交规模增大后大量相似但无关提交的干扰,导致对工具实际性能的高估。
方法
提出RDS现实分布设定与数据集,并设计EasyLink:用向量数据库检索提交,再用大语言模型对候选提交重排序。
评估
在20个开源项目上评测,EasyLink平均Precision@1为75.03%,较SOTA提升四倍以上;同时发现深度学习方法性能大幅下降而VSM更优。
原文摘要(Abstract)

Issue-commit linking, which connects issues with commits that fix them, is crucial for software maintenance. Existing approaches have shown promise in automatically recovering these links. Evaluations of these techniques assess their ability to identify genuine links from plausible but false links. However, these evaluations overlook the fact that, in reality, when a repository has more commits, the presence of more plausible yet unrelated commits may interfere with the tool in differentiating the correct fix commits. To address this, we propose the Realistic Distribution Setting (RDS) and use it to construct a more realistic evaluation dataset that includes 20 open-source projects. By evaluating tools on this dataset, we observe that the performance of the state-of-the-art deep learning-based approach drops by more than half, while the traditional Information Retrieval method, VSM, outperforms it. Inspired by these observations, we propose EasyLink, which utilizes a vector database as a modern Information Retrieval technique. To address the long-standing problem of the semantic gap between issues and commits, EasyLink leverages a large language model to rerank the commits retrieved from the database. Under our evaluation, EasyLink achieves an average Precision@1 of 75.03%, improving over the state-of-the-art by over four times. Additionally, this paper provides practical guidelines for advancing research in issue-commit link recovery.

链接与引用

DOI 原文 · arXiv · DBLP

BibTeX
@inproceedings{abs-2507-09199,
  title = {Back to the Basics: Rethinking Issue-Commit Linking with LLM-Assisted Retrieval},
  author = {Huihui Huang and Ratnadira Widyasari and Ting Zhang and Ivana Clairine Irsan and Jieke Shi and Han Wei Ang and Frank Liauw and Eng Lieh Ouh and Lwin Khin Shar and Hong Jin Kang and David Lo},
  booktitle = {ICSE},
  year = {2026},
  doi = {10.1145/3744916.3764530}
}