一句话:利用Wikipedia自动构建领域特定语料库,提升需求中协调歧义与介词短语附着歧义的检测和解释准确率。
自然语言需求中的歧义长期困扰需求工程,人工处理耗时且易漏掉“未承认歧义”——不同干系人自认理解一致但实际解释不同。本文提出自动化方法,从Wikipedia自动生成领域特定语料库,并将其融入NLP流程,以处理协调歧义(CA)和介词短语附着歧义(PAA)。在20份工业需求文档、7个应用领域、5000余条需求上评估:CA/PAA检测平均精确率80%、召回率89%,未承认歧义召回率90%;自动解释平均准确率85%。相比使用通用语料库的基线,检测准确率提升33%,解释准确率提升16%。
Ambiguity in natural-language requirements is a pervasive issue that has been studied by the requirements engineering community for more than two decades. A fully manual approach for addressing ambiguity in requirements is tedious and time-consuming, and may further overlook unacknowledged ambiguity – the situation where different stakeholders perceive a requirement as unambiguous but, in reality, interpret the requirement differently. In this paper, we propose an automated approach that uses natural language processing for handling ambiguity in requirements. Our approach is based on the automatic generation of a domain-specific corpus from Wikipedia. Integrating domain knowledge, as we show in our evaluation, leads to a significant positive improvement in the accuracy of ambiguity detection and interpretation. We scope our work to coordination ambiguity (CA) and prepositional-phrase attachment ambiguity (PAA) because of the prevalence of these types of ambiguity in natural-language requirements [1]. We evaluate our approach on 20 industrial requirements documents. These documents collectively contain more than 5000 requirements from seven distinct application domains. Over this dataset, our approach detects CA and PAA with an average precision of 80% and an average recall of 89% (90% for cases of unacknowledged ambiguity). The automatic interpretations that our approach yields have an average accuracy of 85%. Compared to baselines that use generic corpora, our approach, which uses domain-specific corpora, has 33% better accuracy in ambiguity detection and 16% better accuracy in interpretation.
@inproceedings{EzziniA0SB21,
title = {Using Domain-Specific Corpora for Improved Handling of Ambiguity in Requirements},
author = {Saad Ezzini and Sallam Abualhaija and Chetan Arora and Mehrdad Sabetzadeh and Lionel C. Briand},
booktitle = {ICSE},
year = {2021},
doi = {10.1109/icse43902.2021.00133}
}