一句话:提出并行 Protobuf 解码编译器,通过长度前缀扫描与推测并行化加速大规模数据解码。
Protobuf 是云环境中广泛使用的二进制序列化格式,但现有编译器只生成串行解码器,难以扩展至大规模数据。针对二进制格式并行解码尚缺研究的问题,论文提出两种技术:利用 Protobuf 的长度前缀编码快速“略读”二进制流以识别解码任务;为缓解大量小字段或不均衡字段导致的低效,进一步引入推测并行化,将二进制均匀分段并预测跨边界解码状态。作者实现 SpecProto 并行化编译器,可依据给定 Protobuf schema 生成并行解码器。在真实与合成数据集上的实验表明,SpecProto 利用多核 CPU 获得显著加速。
Protobuf is a widely used data serialization format, especially in cloud environments. However, existing compilers generate only serial decoders, limiting scalability for large datasets. While parallel parsing has been studied for textual formats (e.g., XML), parallel decoding of binary formats like Protobuf remains unexplored, which present unique opportunities. We propose two techniques to enable parallel Protobuf decoding. First, we leverage the length-prefixed encoding of Protobuf to ''skim'' the binary and identify decoding tasks. To address inefficiencies caused by many small or imbalanced fields, we further introduce speculative parallelization, which partitions a binary into even segments and predicts decoding states across boundaries. We implement these techniques in SpecProto, a parallelizing compiler that generates parallel decoders for a given Protobuf schema. Experiments on real-world and synthetic datasets show that SpecProto achieves significant speedups by leveraging multiple CPU cores.
@inproceedings{WangHPM0Z026,
title = {SpecProto: A Parallelizing Compiler for Speculative Decoding of Large Protocol Buffers Data},
author = {Zhijie Wang and Chales Hong and Dhruv Parmar and Shengbo Ma and Zhijia Zhao and Qidong Zhao and Xu Liu},
booktitle = {ASPLOS},
year = {2026},
doi = {10.1145/3779212.3790225}
}