paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Bifrost: Empowering Pretrained Language Model with Fallibility Representation for Log-Based Fault Diagnosis

Bifrost:赋予预训练语言模型故障性表示以进行基于日志的故障诊断
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026匹配度 2/10 · 该论文聚焦日志表示学习与基于日志的故障诊断,虽涉及机器学习系统运维和工业场景,但与用户核心方向(静态分析、Agentic 程序、LLM 辅助形式化验证/浮点/贝叶斯程序分析)几乎无直接交集。其方法主体是自监督对比学习改进 PLM 日志表示,研究目标也不是 LLM 本身或静态分析。引用 1 inbox
Minghua He, Tong Jia, Lingzhe Zhang, Chiming Duan, Xinlong Zhao, Leyi Pan, Cheng Wang, Kangjin Wang, Yinghao Yu, Liping Zhang, Yifan Wu, Ying Li
crossref: 2026-10-09

AI 速览

一句话:提出 Bifrost,用自监督对比学习为日志学习多层级故障性表示,提升基于日志的故障诊断。

现有基于日志的故障诊断方法常使用自然语言预训练语言模型(PLM)进行日志表示,但系统故障体现在日志的多层级结构中,PLM 难以全面捕获这些多层级故障信息,即 fallibility representations,因而无法满足故障诊断需求。Bifrost 借鉴站点可靠性工程师的日志分析经验,精心设计基于自监督对比学习的策略来学习日志的故障性表示。在三个公开系统和一个工业 ML-as-a-Service 系统上,Bifrost 产生的日志表示优于现有 PLM:异常检测 F1 平均提升 9.83%,根因定位 HR@k 平均提升 18.28%,故障识别 Macro-F1 平均提升 20.88%。

问题
现有方法使用自然语言预训练语言模型表示日志,但难以捕获系统日志多层级结构中反映故障的 fallibility representations,无法满足故障诊断需求。
方法
Bifrost 借鉴站点可靠性工程师的日志分析经验,设计基于自监督对比学习的策略,学习日志的多层级故障性表示。
评估
在三个公开系统和一个工业 ML-as-a-Service 系统上评估,对比现有 PLM,在异常检测、根因定位和故障识别任务上分别取得平均 9.83% F1、18.28% HR@k、20.88% Macro-F1 的提升。
原文摘要(Abstract)

Log-based fault diagnosis is crucial for runtime debugging and maintenance. Existing fault diagnosis methods use language models pre-trained on natural language (PLMs) for log representation. However, system faults are reflected in the multi-level structure of system logs. PLMs pre-trained on natural language struggle to comprehensively capture multi-level fault information, failing to meet the requirements of fault diagnosis. We refer to this information as fallibility representations. To address this problem, we propose a novel log representation learning method, Bifrost. It draws inspiration from the log analysis experience of Site Reliability Engineers and meticulously designs strategies based on self-supervised contrastive learning to learn the fallibility representations of logs. Across three public systems and one industrial ML-as-a-Service system, the log representations produced by Bifrost outperform existing PLMs by average margins of 9.83% in F1 for anomaly detection, 18.28% in HR@k for root cause localization, and 20.88% in Macro-F1 for fault identification.

链接与引用

DOI 原文 · arXiv · DBLP

BibTeX
@inproceedings{abs-2607-23169,
  title = {Bifrost: Empowering Pretrained Language Model with Fallibility Representation for Log-Based Fault Diagnosis},
  author = {Minghua He and Tong Jia and Lingzhe Zhang and Chiming Duan and Xinlong Zhao and Leyi Pan and Cheng Wang and Kangjin Wang and Yinghao Yu and Liping Zhang and Yifan Wu and Ying Li},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3834433}
}