一句话:提出 MESA 框架,用目标、策略、动作三层蜕变测试预言评估智能体,并按层级分解失败。
随着自主系统从数据驱动组件转向能推理、规划和行动的意图驱动智能体,传统测试方法变得不足。智能体产生执行轨迹,其正确性依赖目标、策略和动作构成的层级意图。本文提出 MESA(Metamorphic Evaluation of Systems and Agents),一个模块化框架,将蜕变测试原则适配到智能体评估,通过目标、策略和动作三层预言检查跨抽象层级的一致性关系。与二元成功指标不同,MESA 可按层级分解失败,支持定向调试。该工作将蜕变关系确立为智能体测试的原则性方法,并提供理论基础与实用工具。
As autonomous systems transition from data-driven components to intent-driven agents that reason, plan, and act, traditional testing approaches become inadequate. Agents produce execution traces, and correctness depends on hierarchical intent spanning goals, strategies, and actions. We present MESA (Metamorphic Evaluation of Systems and Agents), a modular framework that adapts metamorphic testing principles to agent evaluation through three oracle layers (Goal, Strategy, and Action) that verify consistency relations across abstraction levels. Unlike binary success metrics, MESA decomposes failures by level, enabling targeted debugging. Our framework establishes metamorphic relations as a principled approach to agent testing, providing theoretical foundations and practical tooling for testing modern agentic systems.