一句话：发布大规模多标注代码函数与注释数据集，支持代码弱点和技术债检测工具的评测与比较。
本文针对代码弱点与技术债检测工具缺乏公开、统一且可比较数据集的问题，提出了 MADE-WIC。该数据集融合已有数据集，从 12 个开源项目中收集了约 86 万个代码函数和超过 270 万条相关注释，并利用多种先进方法为函数及注释提供多标注，覆盖技术债与代码弱点。MADE-WIC 旨在为研究者提供经过整理的基准，用于测试和比较检测工具，同时帮助控制标注定义与数据集构建方式带来的偏差。论文还提供了演示视频。
In this paper, we present MADE-WIC, a large dataset of functions and their comments with multiple annotations for technical debt and code weaknesses leveraging different state-of-the-art approaches. It contains about 860K code functions and more than 2.7M related comments from 12 open-source projects. To the best of our knowledge, no such dataset is publicly available. MADE-WIC aims to provide researchers with a curated dataset on which to test and compare tools designed for the detection of code weaknesses and technical debt. As we have fused existing datasets, researchers have the possibility to evaluate the performance of their tools by also controlling the bias related to the annotation definition and dataset construction. The demonstration video can be retrieved at https://www.youtube.com/watch?v=GaQodPrcb6E.CCS CONCEPTS• Software and its engineering → Maintaining software.
DOI 原文 · arXiv · PDF（开放获取） · DBLP
@inproceedings{abs-2408-05163,
title = {MADE-WIC: Multiple Annotated Datasets for Exploring Weaknesses In Code},
author = {Moritz Mock and Jorge Melegati and Max Kretschmann and Nicolas E. Diaz Ferreyra and Barbara Russo},
booktitle = {ASE},
year = {2024},
doi = {10.1145/3691620.3695348}
}