paperbot · PL 论文追踪

全部论文 待读 收藏

P2 In-Network Aggregation with Transport Transparency for Distributed Training

面向分布式训练的传输透明网络内聚合
ASPLOS Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 32023匹配度 1/10 · 该论文聚焦分布式训练的网内聚合与传输层优化,属于分布式系统/网络方向,与用户关注的静态分析、LLM/Agent、浮点程序分析及贝叶斯程序分析均无直接关联。引用 44 inbox
Shuo Liu, Qiaoling Wang, Junyi Zhang, Wenfei Wu, Qinliang Lin, Yao Liu, Meng Xu, Marco Canini, Ray C. C. Cheung, Jianfei He
crossref: 2026-09-12

AI 速览

一句话:提出传输透明的网络内聚合方案,使分布式训练无需定制传输层即可利用 INA 加速。

现有网络内聚合(INA)方案将 all-reduce 操作卸载到网络交换机,以加速和扩展分布式训练。然而在端主机上,这些方案需要构建定制网络栈来替换传输层。这种面向 INA 的网络栈无法利用当前高性能的传输层实现,也给系统开发与运维带来复杂性。论文提出具有传输透明性的 INA 方案,使分布式训练能够在不替换传输层的情况下使用网络内聚合。摘要未报告具体实现与实验结果。

问题
现有 INA 方案要求端主机替换传输层并定制网络栈,导致无法复用先进传输层且系统复杂。
方法
论文提出传输透明的 INA 设计,使网络内聚合与现有传输层兼容,避免替换传输层。
评估
摘要未给出具体评估设置与结果;需在分布式训练场景中验证其加速、扩展性与部署简化效果。
原文摘要(Abstract)

Recent In-Network Aggregation (INA) solutions offload the all-reduce operation onto network switches to accelerate and scale distributed training (DT). On end hosts, these solutions build custom network stacks to replace the transport layer. The INA-oriented network stack cannot take advantage of the state-of-the-art performant transport layer implementation, and also causes complexity in system development and operation.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot10063,
  title = {In-Network Aggregation with Transport Transparency for Distributed Training},
  author = {Shuo Liu and Qiaoling Wang and Junyi Zhang and Wenfei Wu and Qinliang Lin and Yao Liu and Meng Xu and Marco Canini and Ray C. C. Cheung and Jianfei He},
  booktitle = {ASPLOS},
  year = {2023},
  doi = {10.1145/3582016.3582037}
}