一句话:从务实视角重新审视遗留 Web UI 测试脆弱性的根因,并提出框架扩展、自然语言解耦与务实基准三条缓解路径。
自动化 Web UI 测试可显著降低人工测试的成本,但端到端测试的持续自动化面临多重障碍:脆弱的遗留测试、不理想的自动化框架,以及不利于 UI 测试的 Web 应用设计。已有研究虽多,却大多未能从务实(pragmatic)角度揭示脆弱性的根本成因。本论文首先通过考察真实 Web 应用中测试的脆弱表现,重新评估这些成因;在此基础上扩展现有自动化框架,以缓解由不切实际的框架设计所导致的 flakiness;进而提出以自然语言为中介,将测试用例与被测 Web 应用解耦,从而变革传统 Web UI 测试的组织方式;最后引入一个务实基准,引导后续研究面向更贴近现实的 Web 应用。论文旨在阐明当前挑战,并推动 UI 测试研究采纳更务实的视角。
Automated web UI testing addresses the labor- and time-intensive demands of manual testing. Despite its importance, numerous barriers impede the continuous automation of end-to-end web UI testing: brittle legacy tests, suboptimal automation frameworks, and web app design unsuited for effective UI testing. While many studies investigate these challenges, most overlook the root causes of brittleness from a pragmatic perspective. This dissertation first reassesses these causes by examining the brittleness of testing real-world web apps. Building on that, we extend existing frameworks to mitigate flakiness stemming from impractical automation frameworks. We also transform traditional web UI testing by decoupling test cases from web applications, using natural language as an intermediary. Finally, we introduce a pragmatic benchmark to steer research toward more realistic web applications. Through these studies, we aim to shed light on current challenges and encourage a more pragmatic perspective on UI testing.