一句话：EyeNav 结合眼动追踪与 NLP，实现可访问网页交互，并通过录制回放自动生成测试脚本。
该论文提出 EyeNav，一个将眼动追踪与自然语言处理结合的系统，用于提升网页可访问性并支持自动化测试生成。系统通过注视控制指针，并利用 NLP 解释用户意图，从而实现更直观的多模态网页交互；同时提供录制-回放模块，可将交互过程转化为自动化测试脚本。EyeNav 面向运动障碍用户、开发者、可用性测试者以及希望探索新型多模态网页交互的普通用户。摘要指出该工具已公开并提供演示视频，最终目标是证明其既可作为辅助技术，也可作为软件测试的创新方法；摘要未给出定量评估结果。
In the field of human-computer interaction (HCI), alternative interaction methods are becoming increasingly popular and commercially available. From this opportunity came EyeNav, a system that combines eye-tracking and natural language processing (NLP) to enhance accessibility and enable automated test generation. The integration of these technologies for intuitive web interaction, using pointer control via gaze and natural language processing for interpreting user intentions, also presents a record-and-replay module for generating automated test scripts. Envisioned for users with motor disabilities, developers, usability testers, and general users interested in exploring novel multimodal web interactions. The ultimate goal is to demonstrate that this tool can be used not only as a possible assistive technology but also as an innovative approach to software testing. The tool is available publicly at https://thesoftwaredesignlab.github.io/EyeNav/, accompanied with a demonstration video https://thesoftwaredesignlab.github.io/EyeNav/video.html
DOI 原文 ·
@inproceedings{paperbot9367,
title = {EyeNav: Accessible Webpage Interaction and Testing using Eye-tracking and NLP},
author = {Juan Diego Yepes-Parra and Camilo Escobar-Velásquez},
booktitle = {ASE},
year = {2025},
doi = {10.1109/ase63991.2025.00374}
}