一句话:提出“伦理来源代码生成”概念,通过文献综述与从业者调查构建 11 维分类体系,呼吁关注伦理问题。
论文关注代码生成模型开发中的伦理问题,如许可不清、隐私、公平与环境影响,提出“伦理来源代码生成(ES-CodeGen)”概念,指以伦理且可持续方式管理从数据收集到部署后的整个过程。作者开展两阶段文献综述,审阅 803 篇论文并筛选 71 篇相关文献,得到 10 个初始维度;又调查 32 名从业者,其中包括 6 名曾提交 GitHub issue 以从 Stack 数据集退出的开发者。调查将维度精炼为 11 个并新增代码质量维度,同时识别相关后果、制品与阶段。后调查反思显示,多数从业者常忽视社会相关维度,但多数认为该调查提升了对 ES-CodeGen 的理解。
Several code generation models have been proposed to help reduce time and effort in solving software-related tasks. To ensure responsible AI, there are growing interests over various ethical issues (e.g., unclear licensing, privacy, fairness, and environment impact). These studies have the overarching goal of ensuring ethically sourced generation, which has gained growing attention in speech synthesis and image generation. In this paper, we introduce the novel notion of Ethically Sourced Code Generation (ES-CodeGen) to refer to managing all processes involved in code generation model development from data collection to post-deployment via ethical and sustainable practices. To build a taxonomy of ES-CodeGen , we perform a two-phase literature review where we reviewed 803 papers across various domains and specific to AI-based code generation. We identified 71 relevant papers with 10 initial dimensions of ES-CodeGen. To refine our dimensions and gain insights on consequences of ES-CodeGen, we surveyed 32 practitioners, which include six developers who submitted GitHub issues to opt-out from the Stack dataset (these impacted users have real-world experience of ethically sourced issues in code generation models). The results lead to 11 dimensions of ES-CodeGen with a new dimension on code quality as practitioners have noted its importance. We also identified consequences, artifacts, and stages relevant to ES-CodeGen. Our post-survey reflection showed that most practitioners tended to ignore society-related dimensions despite their importance. Most practitioners either agreed or strongly agreed that our survey help improve their understanding of ES-CodeGen. Our study calls for attention of various ethical issues towards ES-CodeGen.