paperbot · PL 论文追踪

全部论文 待读 收藏

P2 LLM-Powered Fully Automated Chaos Engineering: Towards Enabling Anyone to Build Resilient Software Systems at Low Cost

LLM 驱动的全自动混沌工程:让任何人都能低成本构建弹性软件系统
ASE 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE)2025匹配度 2/10 · 论文将 LLM/Agent 工作流用于 Kubernetes 混沌工程,属于 LLM 作为工具的系统弹性应用,但与用户核心关注的静态分析、形式化验证、浮点程序分析或贝叶斯程序分析没有直接关系,也未涉及对 Agentic 程序本身进行静态分析或让 LLM 改进程序分析。引用 0 inbox
Daisuke Kikuta, Hiroki Ikeuchi, Kengo Tajiri
crossref: 2026-09-12

AI 速览

一句话:提出 ChaosEater,用 LLM 智能体工作流全自动执行 Kubernetes 系统混沌工程全周期,低成本构建弹性系统。

混沌工程(CE)通过向分布式系统故意注入故障来检验弹性、暴露弱点并在生产故障发生前加以修复。现有 CE 工具只能自动执行预定义的实验,而实验规划与基于结果改进系统仍需人工完成,既费时又依赖多领域专家。为让任何人都能低成本构建弹性系统,本文提出 ChaosEater:它按照系统化的 CE 周期预定义一个智能体工作流,并把工作流中细分的子过程交给大语言模型(LLM)完成。ChaosEater 面向构建在 Kubernetes 上的软件系统,其中的 LLM 通过需求定义、代码生成、测试与调试等软件工程任务走完整个 CE 周期。作者在小规模与大规模 Kubernetes 系统上开展案例研究,结果表明它能以显著低的时间与金钱成本稳定完成合理的 CE 周期,其周期质量还经人类工程师与 LLM 定性验证。

问题
混沌工程中实验规划与依据实验结果改进系统仍为人工操作,劳动密集且需要多领域专业知识,阻碍了普通开发者低成本构建弹性系统。
方法
提出 ChaosEater,按系统化 CE 周期预定义智能体工作流,将各细分环节分配给 LLM,使其通过需求定义、代码生成、测试与调试等任务自动完成面向 Kubernetes 系统的完整 CE 周期。
评估
在小规模与大规模 Kubernetes 系统上开展案例研究,测量完成 CE 周期的时间与金钱成本,并由人类工程师和 LLM 对生成周期的合理性做定性验证。
原文摘要(Abstract)

Chaos Engineering (CE) is an engineering technique aimed at improving the resilience of distributed systems. It involves intentionally injecting faults into a system to test its resilience, uncover weaknesses, and address them before they cause failures in production. Recent CE tools automate the execution of predefined CE experiments. However, planning such experiments and improving the system based on the experimental results still remain manual. These processes are labor-intensive and require multi-domain expertise. To address these challenges and enable anyone to build resilient systems at low cost, this paper proposes ChaosEater, a system that automates the entire CE cycle with Large Language Models (LLMs). It predefines an agentic workflow according to a systematic CE cycle and assigns subdivided processes within the workflow to LLMs. ChaosEater targets CE for software systems built on Kubernetes. Therefore, the LLMs in ChaosEater complete CE cycles through software engineering tasks, including requirement definition, code generation, testing, and debugging. We evaluate ChaosEater through case studies on small- and large-scale Kubernetes systems. The results demonstrate that it consistently completes reasonable CE cycles with significantly low time and monetary costs. Its cycles are also qualitatively validated by human engineers and LLMs.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot9422,
  title = {LLM-Powered Fully Automated Chaos Engineering: Towards Enabling Anyone to Build Resilient Software Systems at Low Cost},
  author = {Daisuke Kikuta and Hiroki Ikeuchi and Kengo Tajiri},
  booktitle = {ASE},
  year = {2025},
  doi = {10.1109/ase63991.2025.00331}
}