一句话:通过 Stack Overflow 大规模数据与主题建模,刻画大数据开发者的关注主题及其回答难度。
大数据软件开发日益普遍,但开发者面临诸多挑战;为提供有效支持,需要理解他们关注的主题以及在这些主题上获取答案的难度。本文对 Stack Overflow 开展大规模实证研究:首先构造一组大数据标签以抽取相关帖子,再用主题建模将其归并为大数据主题,并把相似主题聚成类别、构建主题层次;随后分析各主题的流行度与回答难度及其相关性。研究还讨论了对大数据软件开发实践、研究和教育的启示,并与先前工作发现进行比较。
Software developers are increasingly required to write big data code. However, they find big data software development challenging. To help these developers it is necessary to understand big data topics that they are interested in and the difficulty of finding answers for questions in these topics. In this work, we conduct a large-scale study on Stackoverflow to understand the interest and difficulties of big data developers. To conduct the study, we develop a set of big data tags to extract big data posts from Stackoverflow; use topic modeling to group these posts into big data topics; group similar topics into categories to construct a topic hierarchy; analyze popularity and difficulty of topics and their correlations; and discuss implications of our findings for practice, research and education of big data software development and investigate their coincidence with the findings of previous work.
DOI 原文 ·
@inproceedings{paperbot5112,
title = {Going big: a large-scale study on what big data developers ask},
author = {Mehdi Bagherzadeh and Raffi Khatchadourian},
booktitle = {FSE},
year = {2019},
doi = {10.1145/3338906.3338939}
}