paperbot · PL 论文追踪

全部论文 待读 收藏

P2 The Ground Is Shifting: A Reflection on the Foundations of Software Measurement

地基正在移动:对软件度量基础的反思
ASE Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering2026匹配度 4/10 · 论文讨论AI代理使用开发工具产生的痕迹如何破坏软件度量/实证研究的人类来源假设,属于AI与软件工程交叉,但与用户核心方向(静态分析、形式化验证、浮点程序分析、贝叶斯程序分析及其与LLM结合)没有直接的方法或理论关联;仅对理解Agentic程序与工具交互有间接启发。引用 0 inbox
Thomas Bock, Audris Mockus, Bogdan Vasilescu
crossref: 2026-10-09

AI 速览

一句话:指出AI代理使用开发工具生成的痕迹违背人类来源假设,呼吁检测假设失效并开展AI辅助复现研究。

过去六十年,软件度量多依赖人工收集专有数据,后转向复用版本控制等工具痕迹,开源兴起极大扩展了数据可得性,但其隐含假设是这些工具由专业开发者用于构建真实系统。随着工具、数据类型与规模及实证方法演变,数据生成与分析方式的变化已影响许多关于软件开发、维护和演化的既有发现;AI代理如今使用相同工具,使痕迹常违反人类来源假设。为保持研究相关性,作者呼吁检测当代数据中基础假设被违反的情形,并开发在新环境下仍有效的方法,提出系统性的AI辅助复现计划,用现代技术重访关键发现,以在当前数据上获得一致结果。

问题
软件度量长期依赖版本控制等工具痕迹,并默认这些痕迹由人类专业开发者构建真实系统产生;AI代理使用相同工具后,该基础假设常被违反,使既有发现面临失效风险。
方法
通过反思性立场文章分析数据生成、数据类型与规模及实证方法演变对软件度量发现的影响,并提出系统性的AI辅助复现计划,用现代技术重新检验关键发现。
评估
本文以论证与议程倡议为主,未开展新的实证评估;其目标是识别当代数据中基础假设被违反的情形,并建立在当前数据上仍能产生一致结果的度量方法。
原文摘要(Abstract)

For most of the past six decades, software measurement relied on labor-intensive manual collection of proprietary data, which hampered progress. The shift to repurposing traces from version control and related tools dramatically expanded data availability—especially with the rise of open-source software—but hinged on an often unstated assumption: that these tools are used by professional developers to build genuine software systems. However, as trace-generating tools, data types and scale, and empirical methods have all evolved, it has become clear that changes in data generation and analytical approaches affect many prior findings about software development, maintenance, and evolution. With AI agents now actively using these same tools, the resulting traces frequently violate the original assumption of human origin. To preserve the relevance of software measurement research, immediate action is needed: We must detect when foundational assumptions are violated in contemporary data and develop new methodologies that remain valid under changed circumstances. To this end, we propose a systematic AI-assisted replication program that revisits key findings using modern techniques, aiming for methods that yield consistent results on current data to keep software measurement meaningful.

链接与引用

DOI 原文 · arXiv ·

BibTeX
@inproceedings{paperbot12427,
  title = {The Ground Is Shifting: A Reflection on the Foundations of Software Measurement},
  author = {Thomas Bock and Audris Mockus and Bogdan Vasilescu},
  booktitle = {ASE},
  year = {2026},
  doi = {10.1145/3832783.3834553}
}