paperbot · PL 论文追踪

全部论文 待读 收藏

P1 Capturing Semantic Flow of ML-based Systems

捕获基于 ML 的系统的语义流
FSE Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering2025匹配度 5/10 · 论文关注ML系统(含LLM Agent)的内部行为分析,与用户对Agentic程序分析的兴趣有重叠,但其核心是动态分析(测试/调试)而非静态分析,且为概念性立场论文,缺乏实现与benchmark,与用户偏好的问题驱动及工程落地有差距。引用 0 inbox
Shin Yoo, Robert Feldt, Somin Kim, Naryeong Kim
crossref: 2026-09-12

AI 速览

一句话:提出 semantic flow 概念与 semantic flow graph,用 ML 内部状态增强控制流以支持动态分析。

基于机器学习的系统(如含 DNN 或 LLM 的软件)虽提供强大功能,但其内部行为对传统动态分析(如测试)大多不透明,现有分析通常只观察输入相似度或类别标签变化。本文提出 semantic flow,将控制流与执行中的内部状态(如 DNN 某层激活值、LLM agent 某推理步响应的 embedding)结合,形成 semantic flow graph,以刻画传统控制流未显式表示的内部决策。作者给出 DNN 与 LLM agent 两个示例,并概述该表示的性质以及如何借此将现有动态分析技术适配到 ML 软件系统。

问题
ML-based 系统的内部行为对传统动态分析不透明,现有分析多停留于输入相似度或类别标签变化等外部可观测信号。
方法
提出 semantic flow,将控制流与 DNN 激活值、LLM 响应 embedding 等内部状态结合为 semantic flow graph,并以 DNN 与 LLM agent 为例说明。
评估
通过概念阐述与两个示例讨论语义流的性质及其适配现有动态分析技术的路径,未报告实证评估。
原文摘要(Abstract)

ML-based systems are software systems that incorporates machine learning components such as Deep Neural Networks (DNNs) or Large Language Models (LLMs). While such systems enable advanced features such as high performance computer vision, natural language processing, and code generation, their internal behaviour remain largely opaque to traditional dynamic analysis such as testing: existing analysis typically concern only what is observable from the outside, such as input similarity or class label changes. We propose semantic flow, a concept designed to capture the internal behaviour of ML-based system and to provide a platform for traditional dynamic analysis techniques to be adapted to. Semantic flow combines the idea of control flow with internal states taken from executions of ML-based systems, such as activation values of a specific layer in a DNN, or embeddings of LLM responses at a specific inference step of LLM agents. The resulting representation, summarised as semantic flow graphs, can capture internal decisions that are not explicitly represented in the traditional control flow of ML-based systems. We propose the idea of semantic flow, introduce two examples using a DNN and an LLM agent, and finally sketch its properties and how it can be used to adapt existing dynamic analysis techniques for use in ML-based software systems.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot8969,
  title = {Capturing Semantic Flow of ML-based Systems},
  author = {Shin Yoo and Robert Feldt and Somin Kim and Naryeong Kim},
  booktitle = {FSE},
  year = {2025},
  doi = {10.1145/3696630.3728507}
}