paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Carat: Unlocking Value-Level Parallelism for Multiplier-Free GEMMs

Carat:为无乘法器 GEMM 解锁值级并行
ASPLOS Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 22024匹配度 1/10 · 该论文属于面向 GEMM 的硬件体系结构设计,核心是值级并行与无乘法器架构,仅在低精度浮点(FP8)数据格式上与浮点相关;它不涉及静态分析、LLM/Agent 程序分析、形式化验证或贝叶斯程序分析,与用户研究方向基本无关。引用 6 inbox
Zhewen Pan, Joshua San Miguel, Di Wu
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出值级并行计算范式与 Carat 架构,通过时序编码复用唯一乘积,将乘法转为累加,实现无乘法器 GEMM。

针对深度神经网络中通用矩阵乘法(GEMM)的硬件加速,随着批处理和低精度数据(如 FP8)的普及,值复用潜力尚未被充分挖掘。本文提出一种新的计算范式——值级并行(value-level parallelism),即唯一乘积只计算一次,不同输入通过时序编码(temporal coding)订阅(选择)所需乘积。基于此设计的架构 Carat 将乘法转化为累加,以高效的无乘法器硬件执行 GEMM。实验表明,在等面积下,Carat 相比脉动阵列平均提升吞吐量 1.02 倍、能效 1.06 倍;扩展到多节点时,吞吐量和能效分别提升 3.2 倍和 4.3 倍。

问题
如何为面向深度神经网络的 GEMM 加速器挖掘批处理低精度数据(如 FP8)中的值复用潜力,以提升性能与能效。
方法
提出值级并行范式,通过时序编码让唯一乘积只算一次并由输入订阅,进而设计无乘法器架构 Carat,将乘法转为累加来执行 GEMM。
评估
在等面积条件下与脉动阵列对比,并扩展到多节点,测量吞吐量与能效提升。
原文摘要(Abstract)

In recent years, hardware architectures optimized for general matrix multiplication (GEMM) have been well studied to deliver better performance and efficiency for deep neural networks. With trends towards batched, low-precision data, e.g., FP8 format in this work, we observe that there is growing untapped potential for value reuse. We propose a novel computing paradigm, value-level parallelism, whereby unique products are computed only once, and different inputs subscribe to (select) their products via temporal coding. Our architecture, Carat, employs value-level parallelism and transforms multiplication into accumulation, performing GEMMs with efficient multiplier-free hardware. Experiments show that, on average, Carat improves iso-area throughput and energy efficiency by 1.02× and 1.06× over a systolic array and 3.2× and 4.3× when scaled up to multiple nodes.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{0001M024,
  title = {Carat: Unlocking Value-Level Parallelism for Multiplier-Free GEMMs},
  author = {Zhewen Pan and Joshua San Miguel and Di Wu},
  booktitle = {ASPLOS},
  year = {2024},
  doi = {10.1145/3620665.3640364}
}