paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Post-hoc Attention Steering of Large Language Models for Robust Code Understanding under Obfuscation

面向混淆下鲁棒代码理解的大语言模型事后注意力引导
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026匹配度 4/10 · 论文处在程序分析与 LLM 的交叉点,用后向切片和控制流路径引导 LLM 注意力,涉及用户关心的 PL-AI 结合;但其研究目标是提升 LLM 代码理解能力(属用户明确不感兴趣的一类),既非将静态分析用于 ML/Agentic 系统,也非用 LLM 改进静态分析/形式化验证,且与浮点、贝叶斯程序分析两条主线无关。引用 0 inbox
Xiaokai Rong, Aashish Yadavally, Tien N. Nguyen
crossref: 2026-10-09

AI 速览

一句话:提出 CodeSteer,利用程序分析得到的后向切片与控制流路径,在推理时重分配 LLM 注意力以提升混淆代码理解。

代码混淆广泛用于隐藏程序逻辑,给人工与自动化分析带来困难。作者初步研究发现,大语言模型在混淆代码上的性能显著下降,说明其依赖表层词法线索而非深层语义推理。为此提出 CodeSteer:一种事后注意力引导方法,将模型注意力重新分配到语义相关的程序元素上——用于输出预测的后向切片,以及用于执行推理的控制流路径。该方法把轻量级程序分析与推理阶段的注意力引导结合,引导 LLM 关注程序的核心输入—输出依赖。在多个模型与数据集上的实验表明,CodeSteer 显著改善混淆代码上的表现,常能恢复到与未混淆程序相当的准确率。作者还通过缓冲区溢出检测案例展示其实用价值,说明其在恶意软件/漏洞分析与混淆代码逆向中的潜力。

问题
大语言模型在混淆代码上理解能力明显退化,因其倾向于依赖表层词法线索而非程序深层语义依赖。
方法
CodeSteer 结合轻量级程序分析(后向切片、控制流路径)与推理时注意力引导,将 LLM 注意力重定向到语义相关的程序元素。
评估
在多个模型和数据集上对比混淆与未混淆代码的表现,并通过缓冲区溢出检测案例研究验证其实用性。
原文摘要(Abstract)

Code obfuscation is widely used in software systems and malware to conceal program logic and hinder analysis, posing significant challenges for both human developers and automated tools. While large language models (LLMs) have shown strong capabilities in code understanding, our preliminary study shows that LLM performance significantly degrades on obfuscated code, suggesting a reliance on superficial lexical cues rather than deep semantic reasoning. To address this limitation, we propose CodeSteer, a novel attention steering approach that reallocates model attention toward semantically relevant program elements, including backward slices for output prediction and control-flow paths for execution reasoning. Our method integrates lightweight program analysis with inference-time attention steering to guide LLMs toward the core input-to-output dependencies of a program. Experiments across multiple models and datasets demonstrate that CodeSteer significantly improves performance on obfuscated code, often recovering comparable accuracy to the level of unobfuscated programs. We also show CodeSteer’s practical utility through a case study on buffer overflow detection, highlighting its potential for malware/vulnerability analysis and reverse engineering of obfuscated code.

链接与引用

DOI 原文 · arXiv ·

BibTeX
@inproceedings{paperbot12297,
  title = {Post-hoc Attention Steering of Large Language Models for Robust Code Understanding under Obfuscation},
  author = {Xiaokai Rong and Aashish Yadavally and Tien N. Nguyen},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3837556}
}