paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Etna: An Evaluation Platform for Property-Based Testing (Experience Report)

Etna:一个基于属性的测试评估平台(经验报告)
ICFP 7(ICFP)2023匹配度 3/10 · 该论文是函数式编程中基于属性测试(PBT)的经验评估平台,属于测试与工具评估方向,与用户的静态分析、浮点/贝叶斯程序分析及其与 LLM 的交叉等核心议题无直接交集。仅在'缺乏严谨对比、需要可扩展评测平台'这一点上与用户对 benchmark 与问题驱动研究的偏好有微弱呼应,但其对象(PBT 测试策略)并非用户关注的任务场景。引用 10 inbox
Jessica Shi, Alperen Keles, Harrison Goldstein, Benjamin C. Pierce, Leonidas Lampropoulos
crossref: 2026-09-10

AI 速览

一句话:提出 Etna,一个用于经验评估与比较基于属性的测试技术的可扩展平台,并在 Coq 与 Haskell 中开展实验。

基于属性的测试(PBT)在函数式编程中广泛应用,工具和生成策略繁多,但缺乏严谨的实证比较,用户难以选择。本文介绍 Etna:一个面向 PBT 技术的经验评估与比较平台,集成了多种流行 PBT 框架和文献中的测试负载,并具有可扩展架构,便于加入新框架与负载,同时自动处理性能测量等繁琐工作。作者用 Etna 在 Coq 和 Haskell 中对多种流行 PBT 方法进行实验,帮助用户理解最佳实践与权衡。

问题
PBT 工具与输入生成策略众多,但文献缺少严谨的实证比较,用户难以判断不同场景下应选用何种方法。
方法
构建 Etna 平台,集成流行 PBT 框架与测试负载,提供可扩展架构并自动处理性能测量,支持在 Coq 和 Haskell 等环境中进行实验比较。
评估
通过使用 Etna 在 Coq 和 Haskell 中对流行 PBT 方法开展多项实验,展示平台可用性并揭示最佳实践与权衡。
原文摘要(Abstract)

Property-based testing is a mainstay of functional programming, boasting a rich literature, an enthusiastic user community, and an abundance of tools — so many, indeed, that new users may have difficulty choosing. Moreover, any given framework may support a variety of strategies for generating test inputs; even experienced users may wonder which are better in a given situation. Sadly, the PBT literature, though long on creativity, is short on rigorous comparisons to help answer such questions. We present Etna, a platform for empirical evaluation and comparison of PBT techniques. Etna incorporates a number of popular PBT frameworks and testing workloads from the literature, and its extensible architecture makes adding new ones easy, while handling the technical drudgery of performance measurement. To illustrate its benefits, we use Etna to carry out several experiments with popular PBT approaches in both Coq and Haskell, allowing users to more clearly understand best practices and tradeoffs.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@article{paperbot1925,
  title = {Etna: An Evaluation Platform for Property-Based Testing (Experience Report)},
  author = {Jessica Shi and Alperen Keles and Harrison Goldstein and Benjamin C. Pierce and Leonidas Lampropoulos},
  journal = {Proceedings of the ACM on Programming Languages},
  volume = {7},
  number = {ICFP},
  year = {2023},
  doi = {10.1145/3607860}
}