一句话:提出 CP-detector,利用配置变更带来的性能期望作为通用测试预言,检测性能缺陷。
性能缺陷因缺乏 fail-stop 症状而难以检测,现有调试技术通常只能发现已知模式(如低效循环),其关键瓶颈是缺少通用测试预言。本文提出 CP-detector,主张配置的性能期望(吞吐量、延迟、执行时间等)可作为强测试预言候选。理由有两点:已有工作表明多数性能缺陷与配置相关;配置变更反映了对性能变化的常见预期。若实际性能与预期相悖,则相关代码片段很可能存在问题。该思路将配置变化与性能期望差异关联到可疑代码,从而检测未知模式的性能缺陷。摘要未报告具体实现与实验结果,评估信息有限。
Performance bugs are often hard to detect due to their non fail-stop symptoms. Existing debugging techniques can only detect performance bugs with known patterns (e.g., inefficient loops). The key reason behind this incapability is the lack of a general test oracle. Here, we argue that the performance (e.g., throughput, latency, execution time) expectation of configuration can serve as a strong oracle candidate for performance bug detection. First, prior work shows that most performance bugs are related to configurations. Second, the configuration change reflects common expectation on performance changes. If the actual performance is contrary to the expectation, the related code snippet is likely to be problematic.
DOI 原文 ·
@inproceedings{paperbot5895,
title = {CP-detector},
author = {Haochen He and Zhouyang Jia and Shanshan Li and Erci Xu and Tingting Yu and Yue Yu and Ji Wang and Xiangke Liao},
booktitle = {ASE},
year = {2020},
doi = {10.1145/3324884.3416531}
}