一句话:提出端到端 RCA 框架 TraceDiag,用强化学习剪枝服务依赖图,提升大规模微服务根因分析的效率与可解释性。
现代微服务系统通常包含数百个组件,根因分析(RCA)高度依赖人工且效率低下。TraceDiag 是面向大规模微服务系统的端到端 RCA 框架:它利用强化学习为服务依赖图学习剪枝策略,自动去除冗余组件,且策略具有可解释性并能自适应新的 RCA 实例;随后在剪枝后的图上执行基于因果的 RCA 方法,从而兼顾准确率与效率。论文在 Microsoft Exchange 的真实 trace 上评估,性能优于当前先进 RCA 方法;TraceDiag 还集成到 Microsoft M365 Exchange,显著提升系统可靠性并减少 RCA 人工投入。
Root Cause Analysis (RCA) is becoming increasingly crucial for ensuring the reliability of microservice systems. However, performing RCA on modern microservice systems can be challenging due to their large scale, as they usually comprise hundreds of components, leading significant human effort. This paper proposes TraceDiag, an end-to-end RCA framework that addresses the challenges for large-scale microservice systems. It leverages reinforcement learning to learn a pruning policy for the service dependency graph to automatically eliminates redundant components, thereby significantly improving the RCA efficiency. The learned pruning policy is interpretable and fully adaptive to new RCA instances. With the pruned graph, a causal-based method can be executed with high accuracy and efficiency. The proposed TraceDiag framework is evaluated on real data traces collected from the Microsoft Exchange system, and demonstrates superior performance compared to state-of-the-art RCA approaches. Notably, TraceDiag has been integrated as a critical component in the Microsoft M365 Exchange, resulting in a significant improvement in the system's reliability and a considerable reduction in the human effort required for RCA.
DOI 原文 · arXiv · PDF(开放获取) · DBLP
@inproceedings{abs-2310-18740,
title = {TraceDiag: Adaptive, Interpretable, and Efficient Root Cause Analysis on Large-Scale Microservice Systems},
author = {Ruomeng Ding and Chaoyun Zhang and Lu Wang and Yong Xu and Minghua Ma and Xiaomin Wu and Meng Zhang and Qingjun Chen and Xin Gao and Xuedong Gao and Hao Fan and Saravan Rajmohan and Qingwei Lin and Dongmei Zhang},
booktitle = {FSE},
year = {2023},
doi = {10.1145/3611643.3613864}
}