一句话:提出 LQPR,将性能需求量化转化为分类问题,并用轻量语言诱导匹配实现高效自动量化。
性能需求在被抽取后,需要量化才能用于配置调优、性能测试等工程任务的合规检查。现有方法多依赖人工量化,成本高且因需求不精确而易出错。本文提出 LQPR:它将性能需求量化建模为分类问题,并观察到性能需求通常具有强模式且短小简洁,因此设计了一种轻量级的语言诱导匹配机制,而非采用通用大语言模型。作者在多个数据集上与九种先进的基于学习的方法进行比较,结果显示 LQPR 在 75% 以上的案例中排名唯一最佳,同时成本降低约两个数量级。该工作表明,至少对性能需求量化而言,专用方法可能比通用 LLM 驱动方法更合适。
Elicited performance requirements need to be quantified for compliance in different engineering tasks, e.g., configuration tuning and performance testing. Much existing work has relied on manual quantification, which is expensive and error-prone due to the imprecision. In this paper, we present LQPR, a highly efficient automatic approach for performance requirements quantification. LQPR relies on a new theoretical framework that converts quantification as a classification problem. Despite the prevalent applications of Large Language Models (LLMs) for requirement analytics, LQPR takes a different perspective to address the classification: we observed that performance requirements can exhibit strong patterns and are often short/concise, therefore we design a lightweight linguistically induced matching mechanism. We compare LQPR against nine state-of-the-art learning-based approaches over diverse datasets, demonstrating that it is ranked as the sole best for 75% or more cases with two orders less cost. Our work proves that, at least for performance requirement quantification, specialized methods can be more suitable than the general LLM-driven approaches.