paperbot · PL 论文追踪

全部论文 待读 收藏

P2 MiniMalloc: A Lightweight Memory Allocator for Hardware-Accelerated Machine Learning

MiniMalloc:面向硬件加速机器学习的轻量级内存分配器
ASPLOS Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 42023匹配度 3/10 · 该论文属于机器学习编译中的静态内存分配问题,与“PL→AI(将PL技术用于ML系统)”有间接关联;但它不涉及用户核心关注的静态分析、LLM/Agent、浮点程序分析或贝叶斯程序分析,因此匹配度较低。引用 5 inbox
Michael D. Moffitt
crossref: 2026-09-12

AI 速览

一句话:提出一种面向硬件加速器编译的静态内存分配方法,通过规范解搜索、空间推断和支配解消除大幅提升性能并缩小库体积。

该论文针对将机器学习模型编译到专用硬件加速器时的静态内存分配问题,提出 MiniMalloc。方法将分配过程建模为递归深度优先搜索,并将搜索限制在一类规范解上以压缩搜索空间;同时提出空间推断技术,用于剪枝不有希望的部分赋值并更有效回溯;还引入支配解检测与消除机制,避免重复或劣质方案。评估在多个基准上与先前最优方法比较,显示性能有数量级提升,且库体积显著减小。

问题
机器学习模型编译到专用硬件加速器时,如何高效地进行静态内存分配,以降低求解开销和运行时库体积。
方法
采用限制于规范解的递归深度优先搜索,结合空间推断进行剪枝与回溯,并检测和消除支配解。
评估
在多个基准上与先前最佳方法比较,性能提升数量级,库体积显著减小。
原文摘要(Abstract)

We present a new approach to static memory allocation, a key problem that arises in the compilation of machine learning models onto the resources of a specialized hardware accelerator. Our methodology involves a recursive depth-first search that limits exploration to a special class of canonical solutions, dramatically reducing the size of the search space. We also develop a spatial inference technique that exploits this special structure by pruning unpromising partial assignments and backtracking more effectively than otherwise possible. Finally, we introduce a new mechanism capable of detecting and eliminating dominated solutions from consideration. Empirical results demonstrate orders of magnitude improvement in performance as compared to the previous state-of-the-art on many benchmarks, as well as a substantial reduction in library size.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot10108,
  title = {MiniMalloc: A Lightweight Memory Allocator for Hardware-Accelerated Machine Learning},
  author = {Michael D. Moffitt},
  booktitle = {ASPLOS},
  year = {2023},
  doi = {10.1145/3623278.3624752}
}