一句话:系统刻画解耦存储下推的三大瓶颈,提出 TapDB 以惰性求值和算力换 I/O 等机制实现 1.3–2.3 倍加速。
在计算存储解耦架构下,数据库下推被广泛采用,但过去十年网络与 I/O 速度提升而计算与内存子系统停滞,使存储层算力稀缺,传统策略驱动下推失效:瓶颈从网络和 I/O 转向计算。本文通过系统刻画重新审视下推数据库设计,指出三个根因:表结构无关、干扰容忍度低、缺乏操作符调度。基于此,作者构建 TapDB,以惰性求值和用网络/I/O 换计算为核心思想,引入四种机制:基于原位元学习与基数估计的表感知操作符成本估计器、限制执行并发的准入控制、基于 ballooning 的 DRAM-SSD 混合表、关键路径驱动的操作符调度器。原型在 SSB 和 TPCH 基准上运行,相比先前方案取得 1.3–2.3 倍加速。
Database pushdown is a widely adopted technique under compute-storage disaggregation. The rising network and I/O speeds, coupled with stagnated compute and memory subsystems of a disaggregated storage architecture in the past decade, render state-of-the-art policy-driven pushdown designs ineffective. This is because the query performance bottleneck has shifted from network and I/O to compute, where computing power at the storage layer becomes scarce. This paper rethinks pushdown database design via a systematic characterization and identifies three root causes, i.e., table structure agnostic, lower interference tolerance, and lack of operator scheduling. Based on the gathered insights, we build TapDB, a new pushdown database that targets emerging storage disaggregation. Driven by two key ideas (i.e., lazy evaluation and trading network and I/O for compute), TapDB introduces four new mechanisms: a table-aware operator cost estimator based on in-situ meta-learning and cardinality estimation, an admission control scheme to limit execution concurrency, a ballooning-based DRAM-SSD hybrid table, and a critical path-driven operator scheduler. Our prototype shows 1.3-2.3× speedups compared with prior solutions when running SSB and TPCH benchmarks.