一句话:提出基于 Apache RocketMQ 的通用 Serverless 消息架构,实现多协议兼容、单队列无限吞吐与高可扩展性。
消息中间件对分布式系统通信与应用性能至关重要,用户期望以 Serverless 方式只关注消息发布与消费,而业务吞吐增长要求其具备强水平扩展能力。为此,阿里云基于 Apache RocketMQ 实现 Serverless 范式,并以 RabbitMQ、MQTT、Kafka 等主流消息中间件形式提供。论文以难以扩展的开源 RabbitMQ 为案例,构建兼容全部开源客户端的 RocketMQ-based RabbitMQ,为单队列提供无限吞吐上限,且队列元数据管理与消息堆积能力较开源 RabbitMQ 提升超过 1000%。该架构有望支撑阿里云稳定商用,并成为大规模消息系统集群的可靠方案。
Message middleware plays a crucial role in the modern world, facilitating seamless communication between distributed systems and enhancing overall application performance. From the user's standpoint, message middleware should operate in a serverless manner, focusing solely on message publishing and consumption [7]. As business throughput increases, it is essential that any message middleware has robust horizontal scalability. To this end, Alibaba Cloud has implemented a serverless paradigm based on Apache RocketMQ and has developed several mainstream message middleware solutions in this serverless form, such as RabbitMQ, MQTT, and Kafka. Taking RabbitMQ, which is characterized by its hard-to-scale architecture, as a case study, our RocketMQ-based RabbitMQ is compatible with all open-source clients and provides an unlimited throughput limit for single queues. Furthermore, the capabilities for managing queue-related metadata and message accumulation are over 1000% greater than those of open-source RabbitMQ. The RocketMQ-based message middleware serverless architecture is expected to support stable commercial applications in Alibaba Cloud [4] and has the potential to serve as a reliable solution for large-scale message system clusters in the future.
@inproceedings{JiFJL25,
title = {Designing for Scalability: Building a Universal Serverless Messaging Architecture with Apache RocketMQ},
author = {Juntao Ji and Yubao Fu and Rongtong Jin and Qingshan Lin},
booktitle = {FSE},
year = {2025},
doi = {10.1145/3696630.3728536}
}