paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Designing for Scalability: Building a Universal Serverless Messaging Architecture with Apache RocketMQ

为可扩展性而设计:使用 Apache RocketMQ 构建通用 Serverless 消息架构
FSE Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering2025匹配度 1/10 · 论文属于分布式消息中间件与 Serverless 架构,关注 RocketMQ 的多协议兼容、单队列吞吐和工业落地;与用户画像中的静态分析、LLM/Agent、浮点程序分析、贝叶斯程序分析均无直接交集。虽然涉及工业部署,但研究问题与方法不在用户核心方向上。引用 1 inbox
Juntao Ji, Yubao Fu, Rongtong Jin, Qingshan Lin
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出基于 Apache RocketMQ 的通用 Serverless 消息架构,实现多协议兼容、单队列无限吞吐与高可扩展性。

消息中间件对分布式系统通信与应用性能至关重要,用户期望以 Serverless 方式只关注消息发布与消费,而业务吞吐增长要求其具备强水平扩展能力。为此,阿里云基于 Apache RocketMQ 实现 Serverless 范式,并以 RabbitMQ、MQTT、Kafka 等主流消息中间件形式提供。论文以难以扩展的开源 RabbitMQ 为案例,构建兼容全部开源客户端的 RocketMQ-based RabbitMQ,为单队列提供无限吞吐上限,且队列元数据管理与消息堆积能力较开源 RabbitMQ 提升超过 1000%。该架构有望支撑阿里云稳定商用,并成为大规模消息系统集群的可靠方案。

问题
如何在业务吞吐增长时,使消息中间件以 Serverless 形式提供并具备强水平扩展能力,尤其解决 RabbitMQ 等难以扩展架构的限制。
方法
基于 Apache RocketMQ 构建通用 Serverless 消息中间件架构,并将 RabbitMQ 等主流协议实现为兼容开源客户端的 Serverless 服务。
评估
以 RabbitMQ 为案例,与开源 RabbitMQ 对比,报告单队列吞吐上限、队列元数据管理和消息堆积能力提升超过 1000%,并讨论其在阿里云商用与大规模集群中的潜力。
原文摘要(Abstract)

Message middleware plays a crucial role in the modern world, facilitating seamless communication between distributed systems and enhancing overall application performance. From the user's standpoint, message middleware should operate in a serverless manner, focusing solely on message publishing and consumption [7]. As business throughput increases, it is essential that any message middleware has robust horizontal scalability. To this end, Alibaba Cloud has implemented a serverless paradigm based on Apache RocketMQ and has developed several mainstream message middleware solutions in this serverless form, such as RabbitMQ, MQTT, and Kafka. Taking RabbitMQ, which is characterized by its hard-to-scale architecture, as a case study, our RocketMQ-based RabbitMQ is compatible with all open-source clients and provides an unlimited throughput limit for single queues. Furthermore, the capabilities for managing queue-related metadata and message accumulation are over 1000% greater than those of open-source RabbitMQ. The RocketMQ-based message middleware serverless architecture is expected to support stable commercial applications in Alibaba Cloud [4] and has the potential to serve as a reliable solution for large-scale message system clusters in the future.

链接与引用

DOI 原文 · DBLP

BibTeX
@inproceedings{JiFJL25,
  title = {Designing for Scalability: Building a Universal Serverless Messaging Architecture with Apache RocketMQ},
  author = {Juntao Ji and Yubao Fu and Rongtong Jin and Qingshan Lin},
  booktitle = {FSE},
  year = {2025},
  doi = {10.1145/3696630.3728536}
}