paperbot · PL 论文追踪

全部论文 待读 收藏

multiplex: A Modular LLM-Based Mutation Framework

multiplex:一个基于LLM的模块化变异测试框架
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026引用 1 inbox
Megan Maton, Gregory M. Kapfhammer, Phil McMinn
crossref: 2026-10-09

AI 速览

一句话:提出模块化LLM变异测试框架 multiplex,支持研究者实现、配置和比较LLM变异生成技术。

变异测试通过向被测程序注入合成缺陷来评估测试套件充分性;近期LLM可生成更真实、更难杀死的变异体,但现有研究原型多为单一用途,将变异生成技术与LLM提供商和构建环境紧耦合,导致研究者需重复实现才能进行实证比较。本文提出 multiplex,一个基于LLM的模块化变异框架。它允许研究者实现自定义LLM变异生成模块,以原型化或比较技术,并配置和创建针对语言、LLM或框架的模块。论文介绍系统设计与实现,展示如何用 multiplex 进行原型化和比较,并给出实验及未来扩展。工具已开源并提供视频演示。

问题
LLM变异测试研究原型紧耦合变异生成技术、LLM提供商与构建环境,难以复用和公平比较。
方法
提出模块化框架 multiplex,将LLM变异生成技术抽象为可插拔模块,并支持语言、LLM与框架特定模块的配置与创建。
评估
通过系统设计与实现说明、原型化与比较演示以及基于 multiplex 的实验展示其可用性;工具开源并提供视频演示。
原文摘要(Abstract)

Mutation testing introduces synthetic defects into a program under test to assess test suite adequacy. While recent advances in large language models (LLMs) have led to more realistic and hard-to-kill mutants, the field is currently dominated by single-purpose research prototypes that tightly couple the mutant generation technique with the LLM provider and build environment, thereby requiring mutation testing researchers to re-implement techniques for empirical comparison. To address this challenge, this paper introduces multiplex, a modular LLM-based mutation framework. multiplex enables researchers to implement their own LLM-based mutant generation (MG) modules to prototype or compare techniques, as well as configure and create language, LLM or framework-specific modules for extended study. In addition to providing an overview of the system design and implementation, this paper demonstrates how researchers can use multiplex to prototype and compare techniques, along with sharing experiments conducted with multiplex and outlining future extensions. The tool is available at https://github.com/LLM-Mutation/multiplex, and a video demonstration is available at https://youtu.be/l-hj7Pmn3oo.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot12292,
  title = {multiplex: A Modular LLM-Based Mutation Framework},
  author = {Megan Maton and Gregory M. Kapfhammer and Phil McMinn},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3834617}
}