一句话：提出 COMBDroid，以结构化规划与双记忆自动完成移动应用 GUI 组合交互测试，通过率较最优基线提升 103%。
现代移动应用中，组合交互需要同一页面内多个 GUI 控件协同操作，但控件依赖、动态界面跳转与上下文敏感执行使基于预定义模型或状态探索的自动化测试难以可靠完成，LLM 方法又因缺乏协同建模和交互上下文而产生不一致动作。本文提出 COMBDroid：先从 GUI 结构检测组合交互模式，生成页面级交互计划并落地为控件级可执行动作；受数独求解启发，维护上下文记忆（保留功能内执行状态）与经验记忆（捕获可复用交互模式）的双记忆机制；并以可集成模块形式在检测到组合交互时激活、完成后让原工具恢复探索。在 100 个应用、100 个组合交互功能上与 15 个 SOTA 基线对比，通过率最高提升 103%，集成后 activity 覆盖率提升 65%–100%，并发现 37 个新崩溃，其中 26 个已修复。
Combination interactions require coordinated operations across multiple GUI widgets within a page to complete a functional task, which are common in modern mobile apps. However, due to widget dependencies, dynamic interface transitions, and context-sensitive execution, existing automated GUI testing approaches based on predefined models or state exploration struggle to reliably complete such interactions. LLM-based GUI testing methods improve semantic understanding but often generate inconsistent actions due to the lack of coordination modeling and interaction context. To address these challenges, this paper proposes COMBDroid, an automated GUI testing approach that enables reliable completion of combination interactions through structured planning and dual memory. COMBDroid first detects combination interaction patterns from GUI structure, then generates page-level interaction plans and grounds them into widget-level executable actions. Inspired by Sudoku solving, COMBDroid maintains a dual-memory mechanism, where context memory preserves execution states within a functionality and experience memory captures reusable interaction patterns. COMBDroid is designed as an integrable module that activates when combination interactions are detected and allows existing testing tools to resume exploration after completion. We evaluate COMBDroid on 100 combination interaction functionalities collected from 100 mobile apps, comparing it with 15 state-of-the-art GUI testing baselines. COMBDroid achieves 103% higher passing rate than the best baseline and improves activity coverage by 65%-100% when integrated with existing testing tools. Furthermore, GUI testing tools integrated with COMBDroid detect 37 new crash bugs in real-world apps, with 26 fixed and the remaining confirmed by developers, demonstrating its effectiveness in improving GUI testing.
@inproceedings{paperbot12516,
title = {Piece by Piece: Automating Combination Interaction GUI Testing via Planning and Dual Memory},
author = {Zhe Liu and Oujin Wang and Junjie Wang and Chunyang Chen and Mengzhuo Chen and Boyu Wu and Yuekai Huang and Qing Wang},
booktitle = {ASE},
year = {2026},
doi = {10.1145/3832783.3837553}
}