一句话:指出现有工作缺乏面向交互式机器学习 Notebook 开发者编辑的基准。
机器学习开发者常使用 Jupyter 等交互式计算 Notebook 承载数据处理与模型训练代码。Notebook 便于编写 ML 流水线并交互式观察输出,但由于 ML 流水线代码冗长复杂,维护 Notebook(例如增加新功能或修复缺陷)颇具挑战。然而,现有工作缺少与 Notebook 上开发者编辑相关的基准。该论文以该问题为出发点;从标题看,其关注学习如何编辑交互式 ML Notebook,但所提供的摘要未给出具体方法、数据集构造与评估结果的细节。
Machine learning (ML) developers frequently use interactive computational notebooks, such as Jupyter notebooks, to host code for data processing and model training. Notebooks provide a convenient tool for writing ML pipelines and interactively observing outputs. However, maintaining notebooks, e.g., to add new features or fix bugs, can be challenging due to the length and complexity of the ML pipeline code. Moreover, there is no existing benchmark related to developer edits on notebooks.