paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Practitioners’ Expectations on Automated Test Generation

实践者对自动化测试生成的期望
ISSTA Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis2024匹配度 2/10 · 该论文研究自动化测试生成的实践者期望,与用户核心关注的静态分析、Agentic/LLM 程序分析、浮点程序分析和贝叶斯程序分析无直接交集;仅在工业落地与研究-实践差距层面略有共鸣,因此匹配度低。引用 8 inbox
Xiao Yu, Lei Liu, Xing Hu, Jacky Keung, Xin Xia, David Lo
crossref: 2026-09-12

AI 速览

一句话:通过混合方法调研实践者对自动化测试生成的期望,并与近三年研究对比,指出研究与实践的差距及未来方向。

自动化测试生成旨在帮助开发者编写高质量测试并减少手工编写测试代码的负担。尽管该领域已有近五十年研究,但实践者究竟期望自动化测试生成工具具备什么能力、现有研究是否满足这些需求仍不清晰。本文采用混合方法展开实证研究:首先对13位专业人士进行半结构化访谈并作定性分析,随后对来自46个国家、五大洲的339位实践者进行定量问卷调查;最后系统回顾2022至2024年顶级会议论文,将当前研究成果与实践者期望进行对比。通过这一对比,作者识别出自动化测试生成研究与实践需求之间的差距,并为研究者提出未来研究方向,以弥合二者之间的鸿沟。

问题
自动化测试生成研究历史悠久,但缺乏对实践者真实期望的清晰理解,也不清楚现有研究是否满足这些期望。
方法
采用混合方法,先对13位专业人士进行半结构化访谈,再对46个国家的339位实践者开展问卷调查,并回顾2022至2024年顶级会议论文进行对比。
评估
通过定性访谈与定量问卷揭示实践者期望,并将这些期望与近三年文献中的研究现状进行系统比较,据此提炼未来研究方向。
原文摘要(Abstract)

Automated test generation can help developers craft high-quality software tests while mitigating the manual effort needed for writing test code. Despite significant research efforts in automated test generation for nearly 50 years, there is a lack of clarity about what practitioners expect from automated test generation tools and whether the existing research meets their needs. To address this issue, we follow a mixed-methods approach to gain insights into practitioners' expectations of automated test generation. We first conduct the qualitative analysis from semi-structured interviews with 13 professionals, followed by a quantitative survey of 339 practitioners from 46 countries across five continents. We then conduct a literature review of premier venue papers from 2022 to 2024 (in the last three years) and compare current research findings with practitioners' expectations. From this comparison, we outline future research directions for researchers to bridge the gap between automated test generation research and practitioners' expectations.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot8512,
  title = {Practitioners’ Expectations on Automated Test Generation},
  author = {Xiao Yu and Lei Liu and Xing Hu and Jacky Keung and Xin Xia and David Lo},
  booktitle = {ISSTA},
  year = {2024},
  doi = {10.1145/3650212.3680386}
}