一句话:提出 DeepPerf,用带 L1 稀疏正则的深度前馈网络和自动超参搜索,以更少训练数据更准预测可配置软件性能。
可配置软件的不同配置选项组合会显著影响运行时性能,但组合数可能指数增长,难以穷举测量。本文提出 DeepPerf,用深度前馈神经网络结合稀疏正则化(如 L1)对高度可配置软件系统建模,并设计一种实用的搜索策略自动高效调优网络超参数。该方法可处理二元和/或数值型配置选项,在较少训练数据下取得比现有方法更高的性能预测精度。作者在 11 个公开真实数据集上实验,证实了方法的有效性。
Many software systems provide users with a set of configuration options and different configurations may lead to different runtime performance of the system. As the combination of configurations could be exponential, it is difficult to exhaustively deploy and measure system performance under all possible configurations. Recently, several learning methods have been proposed to build a performance prediction model based on performance data collected from a small sample of configurations, and then use the model to predict system performance under a new configuration. In this paper, we propose a novel approach to model highly configurable software system using a deep feedforward neural network (FNN) combined with a sparsity regularization technique, e.g. the L1 regularization. Besides, we also design a practical search strategy for automatically tuning the network hyperparameters efficiently. Our method, called DeepPerf, can predict performance values of highly configurable software systems with binary and/or numeric configuration options at much higher prediction accuracy with less training data than the state-of-the art approaches. Experimental results on eleven public real-world datasets confirm the effectiveness of our approach.