一句话:提出 Fuyao,通过解耦控制流与数据流并利用 DPU 实现函数间直接传输,将延迟降至亚毫秒级。
无服务器计算通常依赖第三方转发在函数间传输数据,这种方案将控制流与数据流耦合,导致传输速度很慢,难以满足 Web 服务的低延迟需求。为此,作者提出将控制流与数据流解耦,实现函数间的直接数据传输,并设计了 Fuyao——首个能将中间数据传输延迟降至亚毫秒级的方案。Fuyao 提供四种不同的数据传输方法,以覆盖节点内和节点间的多样化传输需求;对频繁通信的函数对,它建立有状态直接连接以加速数据交换。作者使用真实代表性基准进行评估,实验表明 Fuyao 的延迟最多优于当前最优系统 57 倍。
Serverless computing typically relies on the third-party forwarding method to transmit data between functions. This method couples control flow and data flow together, resulting in significantly slow data transmission speeds. This challenge makes it difficult for the serverless computing paradigm to meet the low-latency requirements of web services. To solve this problem, we propose decoupling the control flow from the data flow, enabling direct data transfer between functions. We introduce Fuyao, the first intermediate data transfer solution capable of reducing data transfer latency to the sub-millisecond level. Fuyao provides four different data transfer methods to cater to diverse data transfer requirements within or between nodes. For function pairs that communicate frequently, Fuyao builds a stateful direct connection between them, enabling rapid inter-function data exchange. We evaluate Fuyao using real-world representative benchmarks. Experimental results show that Fuyao outperforms state-of-the-art systems by up to 57× on latency.
@inproceedings{LiuZLDCHSQ24,
title = {FUYAO: DPU-enabled Direct Data Transfer for Serverless Computing},
author = {Guowei Liu and Laiping Zhao and Yiming Li and Zhaolin Duan and Sheng Chen and Yitao Hu and Zhiyuan Su and Wenyu Qu},
booktitle = {ASPLOS},
year = {2024},
doi = {10.1145/3620666.3651327}
}