一句话：提出支持视觉与文本查询的拖拽式移动应用屏幕搜索工具 D2S2，可交互迭代检索 UI 示例。
公开数据集缺少多样的 UI 元素表示，限制了基于草图的交互式移动搜索的可扩展性。本文提出 D2S2，一种拖拽式移动应用屏幕搜索方法，支持视觉与文本查询。D2S2 在 58k 个 Rico 屏幕中，根据 UI 元素的类型、位置、形状和文本等属性检索相关 UI 示例，并允许用户迭代修改查询、动态更新结果。作者用 10 名新手软件开发者进行评估：在 19 次尝试中，15 次能在一分钟内于前 20 条结果中找到目标屏幕。该工具已在线开放，并提供开源实现与演示视频。
The lack of diverse UI element representations in publicly available datasets hinders the scalability of sketch-based interactive mobile search. This paper introduces D2S2, a novel approach that addresses this limitation via drag-and-drop mobile screen search, accommodating visual and text-based queries. D2S2 searches 58k Rico screens for relevant UI examples based on UI element attributes, including type, position, shape, and text. In an evaluation with 10 novice software developers D2S2 successfully retrieves target screens within the top-20 search results in 15/19 attempts within a minute. The tool offers interactive and iterative search, updating its search results each time the user modifies the search query. Interested users can freely access D2S2 (http://pixeltoapp.com/D2S2), build on D2S2 or replicate results via D2S2’s open-source implementation (https://github.com/toni-tang/D2S2), or watch D2S2’s video demonstration (https://youtu.be/fdoYiw8lAn0).