paperbot · PL 论文追踪

全部论文 待读 收藏

P2 R <sup>3</sup> -Bench: Reproducible Real-world Reverse Engineering Dataset for Symbol Recovery

R³-Bench:面向符号恢复的可复现真实世界逆向工程数据集
ASE 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE)2025匹配度 3/10 · 论文聚焦二进制逆向工程中的符号恢复与源-二进制对齐数据集/基准,属于ML+PL的交叉,但并非用户核心关注的静态分析、Agentic程序、浮点程序分析或贝叶斯程序分析;LLM仅作为基线评估,未用LLM/Agent改进静态分析或形式化验证。引用 0 inbox
Muzhi Yu, Zhengran Zeng, Wei Ye, Jinan Sun, Xiaolong Bai, Shikun Zhang
crossref: 2026-09-12

AI 速览

一句话:提出 AST-Align 对齐算法并构建 R³-Bench 数据集,使结构体字段真值提升四倍,为二进制符号恢复提供评估基准。

逆向工程中的符号恢复旨在从编译后二进制中恢复变量与数据结构信息。学习式方法依赖二进制表达式与源码精确对齐的数据集,但现有对齐技术难以处理复杂数据访问模式,导致训练数据不完整并限制模型性能。本文提出 AST-Align,跨 x86/ARM 架构与 C/C++/Rust 语言统一变量及结构体访问表达式对齐,生成的结构体字段真值达先前方法四倍。基于该算法构建 R³-Bench:元数据丰富、可扩展,具有明确项目纳入标准与可复现流程,覆盖多架构超千万函数。评估从 n-gram 到 LLM 建立基线,通用 LLM 初始表现差,但在合适示例下显著提升。

问题
学习式二进制符号恢复需要源码与二进制表达式精确对齐的数据集,但复杂数据访问模式使现有对齐方法产生不完整训练数据,制约模型性能与恢复准确率。
方法
提出 AST-Align,跨 x86/ARM 与 C/C++/Rust 统一变量和结构体访问表达式对齐,并据此构建元数据丰富、可复现的 R³-Bench 数据集,覆盖多架构超千万函数。
评估
使用从 n-gram 到大型语言模型的多类方法建立基线,发现通用 LLM 初始效果差,但在提供合适示例后显著提升,验证数据集对模型能力的评估价值。
原文摘要(Abstract)

Symbol recovery in reverse engineering is crucial for restoring variable and data structure information in compiled binaries. While learning-based methods have shown promise in recovering both semantic information (names and types) and syntactic information (shapes), they require comprehensive datasets where expressions in binary code are precisely aligned with their source code equivalents. Current techniques for generating such alignments struggle with complex data access patterns, resulting in incomplete training data and consequently hampering model performance and recovery accuracy. We present AST-Align, a novel technique unifying alignment of variables and struct access expressions across multiple architectures (x86 and ARM) and languages (C/C++/Rust). AST-Align significantly improves the number of generated ground truths, capturing four times more struct fields than previous methods. Using this algorithm, we develop R3-Bench, a metadata-rich, extensible dataset with explicit project inclusion criteria and reproducible processing pipeline, comprising over 10 million functions across multiple architectures. Our evaluation establishes baseline performance by testing various approaches from n-gram models to Large Language Models. The results show that while general LLMs initially perform poorly, their effectiveness dramatically improves with proper demonstration. R3-Bench provides a robust foundation for assessing model capabilities and serves as a valuable reference for future symbol recovery research.

链接与引用

DOI 原文 ·

BibTeX
@inproceedings{paperbot9334,
  title = {R
                    <sup>3</sup>
                    -Bench: Reproducible Real-world Reverse Engineering Dataset for Symbol Recovery},
  author = {Muzhi Yu and Zhengran Zeng and Wei Ye and Jinan Sun and Xiaolong Bai and Shikun Zhang},
  booktitle = {ASE},
  year = {2025},
  doi = {10.1109/ase63991.2025.00026}
}