paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Software Testing of Generative AI Systems: Challenges and Opportunities

生成式AI(GenAI)系统的软件测试:挑战与机遇
ICSE 2023 IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE)2023匹配度 2/10 · 该论文聚焦生成式AI系统本身的软件测试挑战与机遇,属于AI系统质量保障方向,并未涉及静态分析、形式化验证、浮点程序分析或贝叶斯程序分析,也未研究LLM/Agent作为工具改进程序分析,因此与用户研究方向仅通过“ML与PL”标签有非常弱的间接关联。引用 36 inbox
Aldeida Aleti
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:探讨生成式AI系统给软件测试带来的新挑战,并展望未来测试研究的机遇。

本文关注生成式人工智能(GenAI)系统给软件测试带来的新挑战。传统测试技术难以适用于能够生成新颖、创造性输出的 GenAI 系统,因为这些系统具有独特复杂性。作者通过分析这些系统的具体特征,指出传统测试方法为何不足或不再适用,并讨论未来研究机会,以期提升 GenAI 的质量保障与安全防护。作为一篇展望性论文,文章未报告具体实验评估,而是为 GenAI 测试这一快速演进领域勾勒研究议程。

问题
传统软件测试技术难以有效保障生成式AI系统的质量,因其输出新颖、创造性强且系统行为复杂。
方法
通过概念分析,梳理GenAI系统的特性及其对测试带来的挑战,并讨论未来研究机遇。
评估
论文为展望/立场性工作,未进行实证评估,而是提出研究议程与方向。
原文摘要(Abstract)

Software Testing is a well-established area in software engineering, encompassing various techniques and methodologies to ensure the quality of software systems. However, with the arrival of generative artificial intelligence (GenAI) systems, new challenges arise in the testing domain. These systems, capable of generating novel and creative outputs, introduce unique complexities that require novel testing approaches. In this paper, I aim to explore the challenges posed by GenAI systems and discuss potential opportunities for future research in the area of testing. I will touch on the specific characteristics of GenAI systems that make traditional testing techniques inadequate or insufficient. By addressing these challenges and pursuing further research, we can enhance our understanding of how to safeguard GenAI and pave the way for improved quality assurance in this rapidly evolving area.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{abs-2309-03554,
  title = {Software Testing of Generative AI Systems: Challenges and Opportunities},
  author = {Aldeida Aleti},
  booktitle = {ICSE},
  year = {2023},
  doi = {10.1109/icse-fose59343.2023.00009}
}