一句话:提出 RocketHA 高可用设计范式,含六大组件,使分布式日志存储可从崩溃与分区中自动恢复并防止数据丢失。
针对工业级分布式日志存储系统在崩溃、网络分区等故障下难以持续提供高可用与数据完整性的问题,阿里云 RocketMQ 团队提出 RocketHA 设计范式。该范式由六个基础组件构成,面向基于日志的存储软件,支持集群自动故障恢复,并已在开源 RocketMQ 中落地实现。评估结果表明,RocketHA 在保证高可用与数据不丢失的同时,实现了快速恢复和高吞吐,可为同类日志存储系统的高可用设计提供参考。
As a team from Alibaba Cloud, we have developed and open-sourced RocketMQ, a cloud-native “messaging, eventing, streaming” real-time data processing platform that covers cloud-edge-device collaboration scenarios. During the development of RocketMQ, we also formulated RocketHA, a log-based storage high availability design theory that provides a robust solution for distributed log storage software used in industrial applications. RocketHA comprises six fundamental components that enable automatic cluster recovery from failures such as crashes and partitions. This design paradigm has been successfully implemented in the open-source RocketMQ. Our evaluation demonstrates that RocketHA ensures high availability, fast recovery, high throughput, and data loss prevention. We hope that RocketHA will inspire and guide the development of high-availability solutions for all log-based storage systems.
@inproceedings{JiJFGTL23,
title = {RocketHA: A High Availability Design Paradigm for Distributed Log-Based Storage System},
author = {Juntao Ji and Rongtong Jin and Yubao Fu and Yinyou Gu and Tsung-han Tsai and Qingshan Lin},
booktitle = {ASE},
year = {2023},
doi = {10.1109/ase56229.2023.00123}
}