一句话:提出将可编程加速器嵌入计算存储,在无服务器与存储解耦的数据中心中实现高效领域特定加速。
无服务器计算流行之际,数据中心正经历存储解耦和领域特定加速器集成。三者单独有益,但结合后,无服务器函数访问解耦存储的开销会抵消加速收益。论文提出 DSCS-Serverless:将可编程加速器嵌入计算存储,在 25 瓦存储功耗约束内为无服务器模型提供领域特定加速。该设计不同于传统微处理器或 FPGA 集成。8 个应用中,它显著优于 250 瓦 NVIDIA RTX 2080 Ti GPU 的传统解耦系统;与 ARM 核或 Xilinx FPGA 两种计算存储设计相比,端到端加速 3.7/1.7 倍,能耗降低 4.3/1.9 倍,成本效率提升 3.2/2.3 倍。
While (I) serverless computing is emerging as a popular form of cloud execution, datacenters are going through major changes: (II) storage dissaggregation in the system infrastructure level and (III) integration of domain-specific accelerators in the hardware level. Each of these three trends individually provide significant benefits; however, when combined the benefits diminish. On the convergence of these trends, the paper makes the observation that for serverless functions, the overhead of accessing dissaggregated storage overshadows the gains from accelerators. Therefore, to benefit from all these trends in conjunction, we propose In-Storage Domain-Specific Acceleration for Serverless Computing (dubbed DSCS-Serverless1). The idea contributes a server-less model that utilizes a programmable accelerator embedded within computational storage to unlock the potential of acceleration in disaggregated datacenters. Our results with eight applications show that integrating a comparatively small accelerator within the storage (DSCS-Serverless) that fits within the storage's power constraints (25 Watts), significantly outperforms a traditional disaggregated system that utilizes NVIDIA RTX 2080 Ti GPU (250 Watts). Further, the work highlights that disaggregation, serverless model, and the limited power budget for computation in storage device require a different design than the conventional practices of integrating microprocessors and FPGAs. This insight is in contrast with current practices of designing computational storage devices that are yet to address the challenges associated with the shifts in datacenters. In comparison with two such conventional designs that use ARM cores or a Xilinx FPGA, DSCS-Serverless provides 3.7× and 1.7× end-to-end application speedup, 4.3× and 1.9× energy reduction, and 3.2× and 2.3× better cost efficiency, respectively.
DOI 原文 · arXiv · PDF(开放获取) · DBLP
@inproceedings{MahapatraGAKWXK24,
title = {In-Storage Domain-Specific Acceleration for Serverless Computing},
author = {Rohan Mahapatra and Soroush Ghodrati and Byung Hoon Ahn and Sean Kinzer and Shu-Ting Wang and Hanyang Xu and Lavanya Karthikeyan and Hardik Sharma and Amir Yazdanbakhsh and Mohammad Alian and Hadi Esmaeilzadeh},
booktitle = {ASPLOS},
year = {2024},
doi = {10.1145/3620665.3640413}
}