paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Towards Trustworthy AI-Enabled Systems: From Model-Level Reliability to Systemic Assurance

面向可信 AI 赋能系统:从模型级可靠性到系统性保障
FSE Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering2026匹配度 3/10 · 该论文关注不透明 AI 模型的可信保障,采用自动化测试、边界探测与运行时监控,属于 AI 测试与可靠性方向,与用户的 PL→AI 静态分析、AI→PL 形式化验证、浮点/贝叶斯程序分析等核心问题仅有边缘交集(都涉及机器学习系统质量保障)。且其为一篇未来议程式愿景论文,缺乏理论形式化、具体工具或 benchmark 层面的深入贡献。引用 0 inbox
Yuheng Huang
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出以自动化测试刻画与运行时监控相结合的范式,为不透明 AI 模型赋能的关键系统提供可信保障。

将不透明 AI 模型快速集成到关键软件基础设施中,给系统可靠性与可信性带来了根本性挑战。本文以“通过系统性交互获得洞察来解码复杂性”为理念,围绕两个研究问题组织工作:RQ1 测试与刻画,关注自动化输入生成与边界探测,以揭示模型隐藏行为;RQ2 增强与保障,利用挖掘出的行为模式来构建主动防御与运行时监控。作者在多种 AI 模型和多样化任务上进行了大量成功尝试,并进一步提出未来议程,旨在将该范式扩展到更广泛的 AI 生命周期与更复杂的 AI 系统中。

问题
不透明 AI 模型被广泛集成进关键软件基础设施,其可靠性与可信性难以保障,缺乏系统性的刻画与运行时防护手段。
方法
以“通过系统性交互获得洞察”为指导思想,分两条线推进:一是自动化输入生成与边界探测以刻画模型行为,二是基于挖掘出的行为模式构建主动防御与运行时监控。
评估
跨越多种 AI 模型与多样化任务开展了大量成功尝试,属于经验性验证;摘要中未给出具体基准或量化指标。
原文摘要(Abstract)

The rapid integration of opaque AI models into critical software infrastructure creates a fundamental challenge for reliability and trustworthiness. This paper addresses this dilemma through the philosophy of Decoding Complexity by Gaining Insight through Systematic Interaction. We present a body of work organized around two research questions: Testing & Characterization (RQ1), which focuses on automated input generation and boundary probing to reveal hidden behaviors, and Enhancement & Assurance (RQ2), which leverages mined behavioral patterns to engineer active defenses and runtime monitoring. Having made numerous successful attempts across a broad spectrum of AI models and diverse tasks, we outline a future agenda to scale this paradigm to the broader AI lifecycle and more complex AI systems.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{Huang26,
  title = {Towards Trustworthy AI-Enabled Systems: From Model-Level Reliability to Systemic Assurance},
  author = {Yuheng Huang},
  booktitle = {FSE},
  year = {2026},
  doi = {10.1145/3803437.3804867}
}