一句话：提出 UIScreens，分析移动编程教学视频并提取其中展示的 UI 屏幕，支持搜索与定位。
移动应用开发者与学生常通过 YouTube 等平台的视频学习移动编程，但视频中的用户界面（UI）设计难以搜索和定位。本文提出 UIScreens，一个基于 Web 的分析与搜索引擎，通过分析移动编程视频教程的视觉内容，自动识别并提取视频中展示的 UI 屏幕。该工具支持在视频中搜索 UI 屏幕、在每条搜索结果下展示视频内识别出的 UI 屏幕概览，并导航到特定 UI 屏幕被展示和讨论的视频片段。用户研究表明，参与者认为 UIScreens 易用且有用，能帮助快速浏览视频，提取的 UI 屏幕也有助于开发者判断视频与搜索主题的相关性。
Mobile apps are one of the most widely used types of software systems in existence today and more programmers and students learn how to develop them everyday. One of the most popular resources for learning mobile programming are videos hosted on social platforms such as YouTube. While useful, this type of resource has also its limitations, especially when developers are looking for user interface (UI) designs for mobile applications, since these are hard to search for and locate in videos. We propose UIScreens, a web-based analysis and search engine that analyzes the visual contents of mobile programming video tutorials, then identifies and extracts the UI screens displayed in the videos. Our tool offers features such as searching for UI screens in videos, displaying an overview of the UI screens identified in a video under each search result, and navigating to the part of a video where a particular UI screen is being displayed and discussed. In a user study, participants agreed that UIScreens is usable and useful to quickly skim through videos, while the UI screens it extracts can help developers further determine the relevance of videos to a search topic.
@inproceedings{paperbot5719,
title = {UIScreens: extracting user interface screens from mobile programming video tutorials},
author = {Mohammad Alahmadi and Ahmad Tayeb and Abdulkarim Malkadi and Esteban Parra and Sonia Haiduc},
booktitle = {FSE},
year = {2020},
doi = {10.1145/3368089.3417935}
}