paperbot · PL 论文追踪

全部论文 待读 收藏

P2 A Mechanized Algebra of Verified Data Structures for Optimizing Sparse Tensor Programs

用于优化稀疏张量程序的已验证数据结构的机器化代数
PLDI 10(PLDI)2026匹配度 2/10 · 该论文属于形式化验证与编译器优化方向,关注稀疏张量程序的可验证重写与代码生成,与用户的 PL→AI、AI→PL、浮点程序分析及贝叶斯程序分析等核心方向没有直接关联;仅在“形式化验证/程序分析”这一较宽泛层面有间接交集。引用 0 inbox
Amanda Liu, Gilbert Louis Bernstein, Shoaib Kamil, Adam Chlipala, Jonathan Ragan-Kelley
crossref: 2026-09-10

AI 速览

一句话:提出机器化验证框架,用层级抽象定义和组合稀疏张量格式,并在 ATL 调度重写中可靠地将稠密程序优化为稀疏程序。

论文解决稀疏张量程序优化中缺少可组合、可验证格式抽象的问题。作者扩展原先仅支持稠密算子的 ATL 张量语言与调度框架,提出层级化抽象:按维度用编码、访问和迭代函数描述张量格式,并给出保证稀疏结构正确表示原稠密张量的形式性质。基于该抽象,他们组合式定义格式无关的多维压缩与解压缩,证明抽象稀疏格式的顶层可靠性定理;再将该定理作为伴随对重写定理,通过 ATL 现有调度重写把稀疏数据结构和迭代引入稠密内核。最终可从稠密操作数程序推导出可证明语义等价的优化稀疏程序,并证明一组可组合的层级格式实例,覆盖多种经典多维张量压缩格式。

问题
如何为稀疏张量格式建立可组合、可机器验证的抽象,并在张量调度优化中可靠地引入稀疏数据结构与迭代。
方法
扩展 ATL,提出按维度描述编码/访问/迭代及正确性性质的层级化格式抽象;证明格式无关的压缩/解压缩及其顶层可靠性,并将该可靠性作为伴随对重写规则用于调度重写。
评估
通过机器化证明构造从稠密程序到语义等价稀疏程序的推导,并证明一组可组合的层级格式实例能覆盖多种经典多维张量压缩格式。
原文摘要(Abstract)

In this paper, we introduce a verified framework for defining and composing sparse tensor formats. We extend the ATL tensor language and scheduling framework, which formerly could only express dense tensor kernels. We define a levelized abstraction to describe per-dimension tensor formats via their encoding routines, access and iteration functions, and formal properties enforcing soundness of the sparse structures as representations of the original dense tensors. Using this abstraction, we compositionally define format-agnostic, multidimensional compression and decompression functions that are used to express the top-level soundness theorem for these abstract sparse tensor formats. We then use this soundness theorem as an adjoint-pair rewrite theorem to introduce sparse data structures and iteration into a dense tensor kernel via the existing scheduling-rewrite framework of ATL. Overall, we are able to start with a program computing over dense operands and derive a proven semantically equivalent, optimized program computing over sparse structures. We further prove a minimal set of instances of the level-format abstraction, which can be composed and passed as parameters to compression to capture a broad range of canonical, multidimensional tensor-compression formats.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@article{LiuBKCR26,
  title = {A Mechanized Algebra of Verified Data Structures for Optimizing Sparse Tensor Programs},
  author = {Amanda Liu and Gilbert Louis Bernstein and Shoaib Kamil and Adam Chlipala and Jonathan Ragan-Kelley},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {10},
  number = {PLDI},
  year = {2026},
  doi = {10.1145/3808261}
}