一句话:提出三个LLM智能体攻防审对抗自博弈,提升软件验证与技术债检测准确率。
该文探索机器能否通过自我博弈来强化软件,而非玩游戏。作者构建概念验证系统“Code Wars”,包含三个由大语言模型驱动的智能体:攻击者生成含缺陷代码,防御者寻找漏洞,裁判评估二者表现。在攻防循环中,智能体相互促进,形成持续精炼的军备竞赛。初步评估聚焦技术债检测,在基准数据集上准确率从19.73%提升至49.66%。结果表明,受自博弈启发的思路可能有助于软件验证工具的发展。
Self-play has reshaped the landscape of AI, producing agents like AlphaGo and AlphaZero that outmatch human mastery through recursive learning. In this work, we ask: can machines play against themselves not to win games, but to strengthen software? We explore this idea in the realm of software validation, where large language models (LLMs) trained on vast oceans of code hold within them entire worlds of logic, error, and repair. Our proof-of-concept system features three LLM-driven agents: an attacker that crafts flawed code, a defender that hunts for vulnerabilities, and a judge that weighs their wits. In this evolving dance of sabotage and defense, the agents sharpen each other, creating a self-sustaining arms race of refinement. In our preliminary evaluation of adversarial self-play for technical debt detection, we observe improvement in accuracy from 19.73% to 49.66% on a benchmark dataset. Our findings offer an early indication that ideas inspired by self play may contribute to the development of software validation tools.