paperbot · PL 论文追踪

全部论文 待读 收藏

P2 An Objective Improvement Approach to Solving Discounted Payoff Games

求解折扣支付博弈的一种目标改进方法
LMCS vol.Volume 22, Issue 12026匹配度 1/10 · 该论文研究折扣支付博弈的目标改进算法,属于逻辑与自动机/形式化方法中的博弈求解理论,但未涉及静态分析、LLM/Agent、浮点程序分析或贝叶斯程序分析等用户核心交叉方向,与当前研究画像关联很弱。引用 0 inbox
Daniele Dell'Erba, Arthur Dumas, Sven Schewe
crossref: 2026-09-10

AI 速览

一句话:提出一种完全对称的目标改进算法,通过约束系统与误差最小化求解折扣支付博弈。

折扣支付博弈及其归约到的奇偶博弈、平均支付博弈在结构上具有对称性,但现有求解方法(如策略改进与值迭代)往往破坏这种对称性。本文从最优解应具备的性质出发,设计了一种完全对称的收敛方法:为每条边建立不等式约束系统,并通过对每个顶点选择一条出边来更新目标函数,这些出边可视为双方策略的松弛表示。目标是使所选不等式尽可能“紧”,不紧时以两边之差作为误差,并最小化误差总和。当且仅当达到协同最优策略时,所有被选不等式可同时取紧,误差和为零。算法在未找到协同最优策略时,交替地针对给定目标改进解、或针对给定解改进目标,逐步降低误差。该工作挑战了支付博弈求解非策略改进即值迭代的传统二分。

问题
如何在保持问题固有对称性的同时求解折扣支付博弈,并避免现有策略改进或值迭代范式的二分。
方法
构建每条边对应不等式约束系统,以每个顶点的一条出边更新目标函数,通过最小化不等式误差和,并交替改进解与目标函数来逐步收敛。
评估
摘要未报告具体实验或基准评估,主要通过理论性质与等价性论证说明方法:协同最优策略当且仅当所有被选不等式取紧、误差和为零。
原文摘要(Abstract)

While discounted payoff games and classic games that reduce to them, like parity and mean-payoff games, are symmetric, their solutions are not. We have taken a fresh view on the properties that optimal solutions need to have, and devised a novel way to converge to them, which is entirely symmetric. We achieve this by building a constraint system that uses every edge to define an inequation, and update the objective function by taking a single outgoing edge for each vertex into account. These edges loosely represent strategies of both players, where the objective function intuitively asks to make the inequation to these edges sharp. In fact, where they are not sharp, there is an `error' represented by the difference between the two sides of the inequation, which is 0 where the inequation is sharp. Hence, the objective is to minimise the sum of these errors. For co-optimal strategies, and only for them, it can be achieved that all selected inequations are sharp or, equivalently, that the sum of these errors is zero. While no co-optimal strategies have been found, we step-wise improve the error by improving the solution for a given objective function or by improving the objective function for a given solution. This also challenges the gospel that methods for solving payoff games are either based on strategy improvement or on value iteration. arXiv admin note: substantial text overlap with arXiv:2310.01008

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@article{paperbot4020,
  title = {An Objective Improvement Approach to Solving Discounted Payoff Games},
  author = {Daniele Dell'Erba and Arthur Dumas and Sven Schewe},
  journal = {Logical Methods in Computer Science},
  volume = {Volume 22, Issue 1},
  year = {2026},
  doi = {10.46298/lmcs-22(1:17)2026}
}