paperbot · PL 论文追踪

全部论文 待读 收藏

P2 BigSift: automated debugging of big data analytics in data-intensive scalable computing

BigSift:面向数据密集型可扩展计算中大数据分析的自动调试
FSE Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering2018匹配度 2/10 · 该论文研究 Spark 大数据分析程序的自动调试与最小失败输入定位,属于软件测试/调试与数据溯源方向;与用户关注的静态分析、LLM/Agent 结合、浮点程序分析或贝叶斯程序分析没有直接交集。引用 18 inbox
Muhammad Ali Gulzar, Siman Wang, Miryung Kim
crossref: 2026-09-12

AI 速览

一句话:结合增量调试与数据溯源,为 Spark 程序自动定位复现测试失败的最小输入记录集。

大数据分析开发常因数据不干净或错误假设而依赖试错调试;程序崩溃或异常结果出现时,开发者希望定位根因。BigSift 以 Apache Spark 程序、用户定义的测试判定函数和数据集为输入,将增量调试(delta debugging)与数据溯源结合,输出能够复现同一测试失败的最小输入记录集。其技术贡献在于设计系统优化,使自动调试在数据密集型可扩展计算中更接近实用。摘要未报告具体实验与量化结果。

问题
大数据分析开发常因数据不干净或错误假设而需试错调试;出现崩溃或异常结果时,定位根因困难。
方法
BigSift 接受 Spark 程序、用户定义测试 oracle 和数据集,结合 delta debugging 与数据溯源,找出能复现同一测试失败的最小输入记录集,并设计系统优化。
评估
摘要未具体说明评估设置与结果;论文声称通过系统优化使自动化调试在数据密集型可扩展计算中更接近实用。
原文摘要(Abstract)

Developing Big Data Analytics often involves trial and error debugging, due to the unclean nature of datasets or wrong assumptions made about data. When errors (e.g. program crash, outlier results, etc.) arise, developers are often interested in pinpointing the root cause of errors. To address this problem, BigSift takes an Apache Spark program, a user-defined test oracle function, and a dataset as input and outputs a minimum set of input records that reproduces the same test failure by combining the insights from delta debugging with data provenance. The technical contribution of BigSift is the design of systems optimizations that bring automated debugging closer to a reality for data intensive scalable computing.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot4600,
  title = {BigSift: automated debugging of big data analytics in data-intensive scalable computing},
  author = {Muhammad Ali Gulzar and Siman Wang and Miryung Kim},
  booktitle = {FSE},
  year = {2018},
  doi = {10.1145/3236024.3264586}
}