一句话:分析 Hugging Face 上 11278 条用户提问,论证标准化模型卡可自动回答四成以上问题。
复用预训练模型(如 Hugging Face 模型中心)日益普遍,但用户常因缺乏文档而在社区论坛提问,给社区带来负担。本文分析 Hugging Face 模型社区的 11,278 条包含模型相关提问的讨论,考察回答这些问题的投入程度、讨论的高层主题,以及基于模型卡模板标准化回答的潜力。结果显示,回答问题本身投入并不大,但 40.1% 的提问无人回应;主题分析表明讨论集中在模型开发技术细节与故障排查上,说明需要模型提供者更多介入。进一步分析发现,若模型提供者按标准模型卡模板填写模型卡,42.5% 的提问本可得到解答。据此作者建议模型提供者在现有文档章节中补充架构、算法、数据预处理与训练代码等开发细节,并在模板中新增章节以覆盖模型使用与硬件需求等常见问题。
Reusing pre-trained machine learning models is becoming very popular due to model hubs such as Hugging Face (HF). However, similar to when reusing software, many issues may arise when reusing an ML model. In many cases, users resort to asking questions on discussion forums such as the HF community forum. In this paper, we study how we can reduce the community's workload in answering these questions and increase the likelihood that questions receive a quick answer. We analyze 11,278 discussions from the HF model community that contain user questions about ML models. We focus on the effort spent handling questions, the high-level topics of discussions, and the potential for standardizing responses in model cards based on a model card template. Our findings indicate that there is not much effort involved in responding to user questions, however, 40.1% of the questions remain open without any response. A topic analysis shows that discussions are more centered around technical details on model development and troubleshooting, indicating that more input from model providers is required. We show that 42.5% of the questions could have been answered if the model provider followed a standard model card template for the model card. Based on our analysis, we recommend that model providers add more development-related details on the model's architecture, algorithm, data preprocessing and training code in existing documentation (sub)sections and add new (sub)sections to the template to address common questions about model usage and hardware requirements.
DOI 原文 ·
@inproceedings{paperbot8783,
title = {Answering User Questions About Machine Learning Models Through Standardized Model Cards},
author = {Tajkia Rahman Toma and Balreet Grewal and Cor-Paul Bezemer},
booktitle = {ICSE},
year = {2025},
doi = {10.1109/icse55347.2025.00066}
}