paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Voyager: Input-Adaptive Algebraic Transformations for High-Performance Graph Neural Networks

Voyager:面向高性能图神经网络的输入自适应代数变换
ASPLOS Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 32025匹配度 4/10 · 该论文是 GNN 编译器与代数变换优化,属于 PL 与 ML 系统交叉,但未涉及用户核心关注的静态分析、LLM/Agent 程序分析、浮点或贝叶斯程序分析等方向。引用 4 inbox
Yangjie Zhou, Wenting Shen, Jingwen Leng, Shuwen Lu, Zihan Liu, Weihao Cui, Zhendong Zhang, Wencong Xiao, Baole Ai, Yong Li, Wei Lin, Deze Zeng, Yun Liang, Quan Chen, Ning Liu, Minyi Guo
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出输入自适应 GNN 编译器 Voyager,动态生成评估代数变换并运行时选择,GPU 上平均加速 3.5 倍。

图神经网络应用广泛且结构日益复杂,如何实现高性能执行成为关键问题。传统 DNN 中有效的代数变换(算子重排与融合)虽能提升计算与访存效率,但直接用于 GNN 效果不佳:输入图结构多样导致收益难以预测,图结构带来的复杂依赖也限制了现有优化技术。为此作者提出 Voyager,一个面向 GNN 的输入自适应编译器。它不依赖静态优化规则,而是动态生成并评估大量代数变换候选,包括针对图特征设计的新颖重排与融合策略;借助符号图属性高效估计张量形状并剪除低效候选,再由运行时选择模块依据实时输入特征挑选最优变换。在代表性 GNN 模型与数据集上,Voyager 在 GPU 上相较现有最优工作平均取得 3.5 倍加速。

问题
GNN 的高性能执行受输入图结构多样性的制约,直接套用 DNN 的算子重排与融合等代数变换收益不佳,且图结构引入的复杂依赖削弱了现有优化技术的效果。
方法
设计输入自适应编译器 Voyager,动态生成并评估针对图特征的代数变换候选,利用符号图属性估计张量形状、剪枝低性能候选,并通过运行时选择模块按实时输入特征选取最优变换。
评估
在代表性 GNN 模型与数据集上,与现有最优工作对比,Voyager 在 GPU 上平均取得 3.5 倍加速。
原文摘要(Abstract)

Graph neural networks (GNNs) are gaining popularity in diverse application domains and growing in complexity. As a result, it is crucial to achieve high-performance GNN execution. Among various techniques, algebraic transformations, including operator reordering and operator fusion, have been successfully applied to improve the computation and memory access efficiencies of DNN models. However, directly applying these methods to GNNs results in suboptimal performance. This is primarily due to the diversity of input graph structures, making it challenging to predict performance benefits. Additionally, the complex dependencies introduced by these input graph structures limit the effectiveness of existing optimization techniques. To address these challenges, we propose Voyager, an input-adaptive compiler designed specifically for GNNs. Unlike existing methods that rely on static optimization rules, Voyager dynamically generates and evaluates a wide range of algebraic transformation candidates, including novel reordering and fusion strategies tailored to graph characteristics. By leveraging symbolic graph attributes, Voyager efficiently estimates tensor shapes and prunes low-performance candidates. A runtime selection module further enhances performance by choosing the optimal transformation based on real-time input features. Our evaluation shows that Voyager achieves an average 3.5 × speedup on GPUs over the state-of-the-art works on representative GNNs and datasets.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{0001SLL0C0XA00Z25,
  title = {Voyager: Input-Adaptive Algebraic Transformations for High-Performance Graph Neural Networks},
  author = {Yangjie Zhou and Wenting Shen and Jingwen Leng and Shuwen Lu and Zihan Liu and Weihao Cui and Zhendong Zhang and Wencong Xiao and Baole Ai and Yong Li and Wei Lin and Deze Zeng and Yun Liang and Quan Chen and Ning Liu and Minyi Guo},
  booktitle = {ASPLOS},
  year = {2025},
  doi = {10.1145/3676642.3736121}
}