paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Reconfigurable Torus Fabrics for Multi-tenant ML

面向多租户 ML 的可重构环面互连结构
ASPLOS Proceedings of the 31st ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 22026匹配度 1/10 · 该论文研究服务器内加速器之间的可编程光子互连与多租户 ML 带宽/碎片问题,属于硬件体系结构与数据中心网络方向,不涉及静态分析、LLM/Agent 程序分析、浮点程序分析或贝叶斯程序分析。引用 2 inbox
Abhishek Vijaya Kumar, Eric Ding, Arjun Devraj, Darius Bunandar, Rachee Singh
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出可编程光子互连 Morphlux,重构服务器内加速器网络,提升多租户 ML 带宽、降低碎片并加速故障替换。

多租户 ML 数据中心常采用环面(torus)拓扑互连加速器,但固定拓扑会导致租户带宽受限、计算碎片和单点故障影响范围大。本文提出 Morphlux,一种服务器规模的可编程光子互连结构,可在服务器内动态重构加速器之间的连接。作者构建了端到端硬件原型,并在基于 torus 的先进 ML 数据中心场景中评估。结果表明,Morphlux 可将租户计算分配的带宽提升最高 66%,将计算碎片降低最高 70%,并缩小加速器故障的影响范围;在硬件测试床上,它使 ML 模型微调吞吐提升 1.72 倍,并能在 1.2 秒内用健康加速器替换故障加速器。

问题
多租户 ML 数据中心中,基于 torus 的加速器互连难以同时满足租户带宽需求、减少计算碎片并限制加速器故障影响范围。
方法
设计并实现 Morphlux——服务器规模可编程光子 fabric,可快速重配置服务器内加速器互连,以增强现有 torus ML 数据中心。
评估
构建端到端硬件原型,在 ML 微调等负载上测量带宽、计算碎片、吞吐与故障替换时间。
原文摘要(Abstract)

We develop Morphlux, a server-scale programmable photonic fabric to interconnect accelerators within servers. We show that augmenting state-of-the-art torus-based ML datacenters with Morphlux can improve the bandwidth of tenant compute allocations by up to 66%, reduce compute fragmentation by up to 70%, and minimize the blast radius of accelerator failures. We develop a novel end-to-end hardware prototype of Morphlux to demonstrate these performance benefits which translate to 1.72x improvement in finetuning throughput of ML models. By rapidly programming the server-scale fabric in our hardware testbed, Morphlux can replace a failed accelerator with a healthy one in 1.2 seconds.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{Kumar0DBS26,
  title = {Reconfigurable Torus Fabrics for Multi-tenant ML},
  author = {Abhishek Vijaya Kumar and Eric Ding and Arjun Devraj and Darius Bunandar and Rachee Singh},
  booktitle = {ASPLOS},
  year = {2026},
  doi = {10.1145/3779212.3790238}
}