paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Automated classification of actions in bug reports of mobile apps

移动应用缺陷报告中动作的自动分类
ISSTA Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis2020匹配度 3/10 · 论文将应用静态分析与NLP/机器学习结合用于移动应用缺陷报告中的动作分类,属于PL+ML及测试调试的交叉,但与用户核心关注的LLM/Agentic程序静态分析、用LLM/Agent改进静态分析、浮点程序分析或贝叶斯程序分析没有直接关联。引用 24 inbox
Hui Liu, Mingzhu Shen, Jiahao Jin, Yanjie Jiang
crossref: 2026-09-12

AI 速览

一句话:提出 MaCa,结合自然语言处理、应用静态分析与机器学习,自动识别并分类移动应用缺陷报告中的动作词。

移动应用缺陷报告通常包含复现步骤,自动复现依赖对其中动作的识别与分类。现有方法多使用预定义词表,受限于用户用词多样性和上下文歧义。本文提出 MaCa:对给定缺陷报告先用自然语言处理识别动作词,再抽取其上下文,包括所在片段、关联 UI 目标及目标元素类型,其中目标元素类型通过自然语言处理与对关联应用的静态分析获得;随后将动作词与上下文输入机器学习分类器预测动作类别。作者从 207 个应用的 525 份缺陷报告中人工标注 1,202 个动作词用于训练。评估显示分类准确率为 95%–96.7%;将 MaCa 集成到 ReCDroid 与 Yakusu 后,缺陷复现成功率分别相对提升 22.7% 和 22.9%。

问题
现有基于预定义词表的方法难以覆盖用户多样化的动作表达,且同一动作词在不同上下文中可能属于不同类别,导致缺陷报告动作识别与分类不准确。
方法
提出 MaCa,用自然语言处理识别动作词,抽取所在片段、关联 UI 目标和目标元素类型(结合自然语言处理与静态分析),再用机器学习分类器基于动作词及上下文预测动作类别。
评估
在来自 207 个应用的 525 份缺陷报告、1,202 个人工标注动作词上评估,MaCa 准确率达 95%–96.7%;集成到 ReCDroid 和 Yakusu 后,复现成功率分别相对提升 22.7% 和 22.9%。
原文摘要(Abstract)

When users encounter problems with mobile apps, they may commit such problems to developers as bug reports. To facilitate the processing of bug reports, researchers proposed approaches to validate the reported issues automatically according to the steps to reproduce specified in bug reports. Although such approaches have achieved high success rate in reproducing the reported issues, they often rely on a predefined vocabulary to identify and classify actions in bug reports. However, such manually constructed vocabulary and classification have significant limitations. It is challenging for the vocabulary to cover all potential action words because users may describe the same action with different words. Besides that, classification of actions solely based on the action words could be inaccurate because the same action word, appearing in different contexts, may have different meaning and thus belongs to different action categories. To this end, in this paper we propose an automated approach, called MaCa, to identify and classify action words in Mobile apps’ bug reports. For a given bug report, it first identifies action words based on natural language processing. For each of the resulting action words, MaCa extracts its contexts, i.e., its enclosing segment, the associated UI target, and the type of its target element by both natural language processing and static analysis of the associated app. The action word and its contexts are then fed into a machine learning based classifier that predicts the category of the given action word in the given context. To train the classifier, we manually labelled 1,202 actions words from 525 bug reports that are associated with 207 apps. Our evaluation results on manually labelled data suggested that MaCa was accurate with high accuracy varying from 95% to 96.7%. We also investigated to what extent MaCa could further improve existing approaches (i.e., Yakusu and ReCDroid) in reproducing bug reports. Our evaluation results suggested that integrating MaCa into existing approaches significantly improved the success rates of ReCDroid and Yakusu by 22.7% = (69.2%-56.4%)/56.4% and 22.9%= (62.7%-51%)/51%, respectively.

链接与引用

DOI 原文 ·

BibTeX
@inproceedings{paperbot6055,
  title = {Automated classification of actions in bug reports of mobile apps},
  author = {Hui Liu and Mingzhu Shen and Jiahao Jin and Yanjie Jiang},
  booktitle = {ISSTA},
  year = {2020},
  doi = {10.1145/3395363.3397355}
}