paperbot · PL 论文追踪

全部论文 待读 收藏

P2 QED in Context: An Observation Study of Proof Assistant Users

情境中的 QED:一项针对证明助手用户的观察研究
OOPSLA 9(OOPSLA1)2025匹配度 3/10 · 论文聚焦 Rocq/Lean 证明助手用户的观察与可用性,属于形式化验证/证明工程的人因研究;但与用户核心兴趣(LLM/Agent 改进静态分析或形式化验证、浮点/贝叶斯程序分析)缺少直接的方法、工具或 LLM 交叉关联,因此匹配度较低。引用 2 inbox
Jessica Shi, Cassia Torczon, Harrison Goldstein, Benjamin C. Pierce, Andrew Head
crossref: 2026-09-10

AI 速览

一句话:通过情境访谈观察 30 名 Rocq 和 Lean 用户,揭示证明助手实际使用中的迭代、对话、外部资源与超越 QED 的设计诉求。

本文关注交互式定理证明器虽重要却难用,设计改进缺乏以用户为中心的理解。作者采用情境访谈(contextual inquiry)方法,观察 30 名参与者在日常工作中使用 Rocq 和 Lean,并对其经验做定性分析。研究提炼出四点观察:证明者根据证明助手反馈反复迭代;证明进展常表现为与证明助手进行有挑战的“对话”;证明构建依赖广泛外部资源;证明者还受“得到 QED”之外的设计考量指引。这些发现刻画了当前证明助手使用的真实面貌,并指出研究者改进可用性时可考虑的潜在机会。

问题
证明助手在计算机科学与数学中很重要,但即便专家也难以高效使用;要改进设计,需要更深入、以用户为中心地理解证明助手的真实使用方式。
方法
采用情境访谈(contextual inquiry)方法,观察 30 名参与者在日常工作中使用 Rocq 和 Lean,并对其经验进行定性分析。
评估
通过定性分析提炼出四类主题或观察,刻画当前证明助手使用现状,并识别可用性改进机会;属于观察性用户研究,而非受控实验或量化评估。
原文摘要(Abstract)

Interactive theorem provers, or proof assistants, are important tools across many areas of computer science and mathematics, but even experts find them challenging to use effectively. To improve their design, we need a deeper, user-centric understanding of proof assistant usage. We present the results of an observation study of proof assistant users. We use contextual inquiry methodology, observing 30 participants doing their everyday work in Rocq and Lean. We qualitatively analyze their experiences to surface four observations: that proof writers iterate on their proofs by reacting to and incorporating feedback from the proof assistant; that proof progress often involves challenging conversations with the proof assistant; that proofs are constructed in consultation with a wide array of external resources; and that proof writers are guided by design considerations that go beyond “getting to QED.” Our documentation of these themes clarifies what proof assistant usage looks like currently and identifies potential opportunities that researchers should consider when working to improve the usability of proof assistants.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@article{paperbot3179,
  title = {QED in Context: An Observation Study of Proof Assistant Users},
  author = {Jessica Shi and Cassia Torczon and Harrison Goldstein and Benjamin C. Pierce and Andrew Head},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {9},
  number = {OOPSLA1},
  year = {2025},
  doi = {10.1145/3720426}
}