paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Efficient Compactions between Storage Tiers with PrismDB

PrismDB:存储层级之间的高效 Compaction
ASPLOS Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 32023匹配度 0/10 · 该论文研究的是键值存储引擎在多层 NVMe 存储之间的 compaction 与数据迁移,属于数据库/存储系统方向;用户画像关注静态分析、LLM/Agent 与程序分析、浮点程序分析和贝叶斯程序分析,二者没有交集。引用 15 inbox
Ashwini Raina, Jianan Lu, Asaf Cidon, Michael J. Freedman
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:PrismDB 通过跨层数据迁移与 compaction 算法,在快慢两层 NVMe 存储间实现性能与成本的帕累托高效平衡。

新兴存储硬件在性能与每比特成本上目标分化,导致数据系统通常只能优化快速但昂贵或低成本但慢速的一侧。本文提出 PrismDB,一个原生利用 3D XPoint 与 QLC NAND 两层 NVMe 存储的键值存储引擎。其核心贡献是跨存储层的高效数据迁移与 compaction:借鉴日志清理的成本收益分析,算法在快速层回收热对象空间所获收益与慢速层 compaction I/O 成本之间进行权衡。评估显示,与当今数据中心中闪存上标准 RocksDB 的使用方式相比,PrismDB 在分层存储上的平均吞吐快 3.3 倍,读尾延迟好 2 倍,并在等价价格硬件上耐久性高 5 倍。

问题
现有数据系统通常只针对快速但昂贵的存储或低成本但慢速的存储优化,难以同时兼顾性能与每比特成本。
方法
PrismDB 原生使用 3D XPoint 和 QLC NAND 两层存储,提出受日志清理成本收益分析启发的跨层迁移与 compaction 算法,权衡快速层热对象空间回收收益与慢速层 compaction I/O 成本。
评估
与数据中心中闪存上的标准 RocksDB 相比,PrismDB 平均吞吐提升 3.3 倍,读尾延迟改善 2 倍,在等价价格硬件上耐久性提升 5 倍。
原文摘要(Abstract)

In recent years, emerging storage hardware technologies have focused on divergent goals: better performance or lower cost-per-bit. Correspondingly, data systems that employ these technologies are typically optimized either to be fast (but expensive) or cheap (but slow). We take a different approach: by architecting a storage engine to natively utilize two tiers of fast and low-cost storage technologies, we can achieve a Pareto efficient balance between performance and cost-per-bit. This paper presents the design and implementation of PrismDB, a novel key-value store that exploits two extreme ends of the spectrum of modern NVMe storage technologies (3D XPoint and QLC NAND) simultaneously. Our key contribution is how to efficiently migrate and compact data between two different storage tiers. Inspired by the classic cost-benefit analysis of log cleaning, we develop a new algorithm for multi-tiered storage compaction that balances the benefit of reclaiming space for hot objects in fast storage with the cost of compaction I/O in slow storage. Compared to the standard use of RocksDB on flash in datacenters today, PrismDB’s average throughput on tiered storage is 3.3× faster, its read tail latency is 2× better, and it is 5× more durable using equivalently-priced hardware.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{RainaLCF23,
  title = {Efficient Compactions between Storage Tiers with PrismDB},
  author = {Ashwini Raina and Jianan Lu and Asaf Cidon and Michael J. Freedman},
  booktitle = {ASPLOS},
  year = {2023},
  doi = {10.1145/3582016.3582052}
}