paperbot · PL 论文追踪

全部论文 待读 收藏

P2 BitRed: Taming Non-Uniform Bit-Level Sparsity with a Programmable RISC-V ISA for DNN Acceleration

BitRed:通过可编程 RISC-V ISA 驯服非均匀位级稀疏性以加速 DNN
ASPLOS Proceedings of the 31st ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 22026匹配度 1/10 · 该论文属于DNN硬件加速器与RISC-V ISA设计,核心是位级稀疏加速和负载均衡,未涉及静态分析、LLM/Agent、浮点程序分析或贝叶斯程序分析。与用户研究画像基本无关。引用 1 inbox
Yanhuan Liu, Wenming Li, Kunming Zhang, Yuqun Liu, Siao Wen, Lexin Wang, Tianyu Liu, Haibin Wu, Zhihua Fan, Xiaochun Ye, Dongrui Fan, Xuejun An
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出 BitRed,用可编程 RISC-V ISA 扩展将非均匀位级稀疏加速转化为灵活调度,显著提速并平衡负载。

位级稀疏性(BLS)非均匀且动态,导致并行加速器负载不均;Bitlet 等位交织范式受刚性数据通路和通道间失衡限制。本文提出 BitRed,以可编程自适应位交织为核心,将加速拆解为预处理 cal.pre、动态负载均衡的自适应蒸馏 cal.adis 与 PDP 最优归约 cal.red 三组正交 RISC-V ISA 扩展,把硬件难题转为灵活调度。在多种基准(相对 SCNN 归一化)上,BitRed 较 Bitlet 最高加速 9.4×、较 BitWave 5.6×,推理效率最高为 Bitlet 的 7.6×;28nm 下面积 5.072mm²,功耗 550.43mW(float32)至 457.90mW(8b),较 A100/Jetson Orin 32GB 最高提升 18.9×/13.5×。

问题
非均匀动态的位级稀疏性给并行 DNN 加速器带来严重的通道间负载不均,现有位交织架构(如 Bitlet)数据通路刚性,难以适应。
方法
提出 BitRed 加速器及可编程自适应位交织,核心 ASPU 将加速过程分解为 cal.pre、cal.adis、cal.red 三组正交 RISC-V ISA 扩展,以调度方式实现动态负载均衡与 PDP 最优归约。
评估
在多种基准上相对 SCNN 归一化评估,与 Bitlet、BitWave 及 GPU(A100、Jetson Orin 32GB)比较速度、推理效率、面积与功耗,并测试跨精度通用性。
原文摘要(Abstract)

The non-uniform and dynamic nature of Bit-Level Sparsity (BLS) poses a critical load-imbalance challenge for parallel hardware accelerators. While the Bit-Interleaving paradigm, represented by state-of-the-art accelerators like Bitlet, shows promise, it is fundamentally constrained by a rigid datapath and severe inter-channel load imbalance. This paper introduces BitRed, an accelerator that embodies a new ''programmable adaptive bit-interleaving'' philosophy. Rather than a monolithic design, BitRed's core is an Adaptive-Sparse Processing Unit (ASPU) that deconstructs the acceleration process into a set of orthogonal RISC-V ISA extensions for pre-processing (cal.pre), adaptive distillation with dynamic load balancing (cal.adis), and PDP-optimal reduction (cal.red). By transforming a rigid hardware problem into a flexible scheduling problem, this ISA-based approach provides a fundamentally more adaptable and extensible solution. Empirical studies on a broad set of benchmarks highlight the following results (normalized to a SCNN baseline): (1) up to 9.4× speedup over the Bitlet, and 5.6× over the latest bit-serial SOTA BitWave; (2) up to 7.6× higher inference efficiency than Bitlet on representative models; (3) 5.072mm2 area and scalable power consumption from 550.43mW (float32) to 495.12mW (16b) and 457.90mW (8b) @28nm TSMC; and (4) high versatility across precisions, and up to 18.9×13.5× higher than NVIDIA A100 and Jetson Orin 32GB, demonstrating significant competitiveness against GPUs.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{LiuLZLWW0WFYFA26,
  title = {BitRed: Taming Non-Uniform Bit-Level Sparsity with a Programmable RISC-V ISA for DNN Acceleration},
  author = {Yanhuan Liu and Wenming Li and Kunming Zhang and Yuqun Liu and Siao Wen and Lexin Wang and Tianyu Liu and Haibin Wu and Zhihua Fan and Xiaochun Ye and Dongrui Fan and Xuejun An},
  booktitle = {ASPLOS},
  year = {2026},
  doi = {10.1145/3779212.3790132}
}