paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Human-aligned AI Model Cards with Weighted Hierarchy Architecture

具有加权层级架构的人类对齐 AI 模型卡
FSE Proceedings of the 34th ACM International Conference on the Foundations of Software Engineering2026匹配度 1/10 · 该论文聚焦 LLM 模型卡、文档披露框架与负责任 AI 治理,不涉及静态分析、程序分析、浮点程序分析、贝叶斯程序分析,也不涉及 Agentic 程序的静态分析或 LLM 与程序分析的交叉,因此与研究方向基本无关。引用 0 inbox
Pengyue Yang, Haolin Jin, Qingwen Zeng, Jiawen Wen, Harry Rao, Huaming Chen
crossref: 2026-09-12dblp: 2026-09-12arxiv: 2026-09-12

AI 速览

一句话:提出 CRAI-MCF,将 LLM 模型卡从静态披露转为可量化、价值对齐的八模块文档框架。

随着大语言模型生态中专用模型快速增长,模型发现与采用面临文档不一致、不完整、不均衡的问题。现有 Model Cards 与 FactSheets 等框架虽推进了标准化报告,但多偏静态、定性,缺乏支持严格跨模型比较的量化机制。为此,本文提出 Comprehensive Responsible AI Model Card Framework(CRAI-MCF),基于价值敏感设计,对 240 个开源项目进行实证分析,将 217 个参数提炼为八个价值对齐模块,并引入量化充分性准则,以统一方案操作化文档充分性并支持跨模型比较。该框架整合技术、伦理与操作维度,提供结构化、可扩展的模板,用于 LLM 文档的撰写、组织与维护,评分则作为优先级排序和充分性检查的轻量辅助。

问题
LLM 专用模型生态碎片化,现有模型卡和 FactSheets 等文档静态、定性且不一致,难以进行严格的跨模型比较,导致模型利用不足并阻碍负责任采用。
方法
基于价值敏感设计,对 240 个开源项目进行实证分析,将 217 个参数提炼为八模块价值对齐架构,并引入量化充分性准则与评分机制。
评估
通过 240 个开源项目的实证分析提炼参数并构建八模块架构;评分用于文档充分性检查与跨模型比较的轻量级优先级排序辅助。
原文摘要(Abstract)

The proliferation of Large Language Models (LLMs) has led to a burgeoning ecosystem of specialized, domain-specific models. While this rapid growth accelerates innovation, it has simultaneously created significant challenges in effective model discovery and adoption. Users often struggle to navigate this fragmented landscape due to inconsistent, incomplete, and imbalanced documentation across platforms. Existing documentation frameworks, such as Model Cards and FactSheets, have advanced efforts toward standardize reporting, which are still often static, largely qualitative, and not always well suited for rigorous cross-model comparison lacking quantitative mechanisms. This gap exacerbates model underutilization and impedes responsible adoption. To address these gaps, we introduce the Comprehensive Responsible AI Model Card Framework (CRAI-MCF), a novel framework that transitions from static disclosures to actionable, human-aligned documentation. Grounded in Value Sensitive Design, CRAI-MCF is built upon an empirical analysis of 240 open-source projects, distilling 217 parameters into an eight-module, value-aligned architecture. Our framework introduces a quantitative sufficiency criterion to operationalize documentation sufficiency and support more rigorous cross-model documentation comparison within a unified scheme. By integrating technical, ethical, and operational dimensions, CRAI-MCF provides a structured and extensible template for authoring, organizing, and maintaining LLM documentation, with scoring used as a lightweight aid for prioritization and sufficiency checking.

链接与引用

DOI 原文 · arXiv · PDF(开放获取) · DBLP

BibTeX
@inproceedings{abs-2510-06989,
  title = {Human-aligned AI Model Cards with Weighted Hierarchy Architecture},
  author = {Pengyue Yang and Haolin Jin and Qingwen Zeng and Jiawen Wen and Harry Rao and Huaming Chen},
  booktitle = {FSE},
  year = {2026},
  doi = {10.1145/3803437.3805265}
}