一句话：首个从自然语言任务描述自动生成 Excel 教程文档与视频的 GUI 框架，基于 Execution Agent 采集中间产物。
Excel 功能繁多且版本迭代快，现有教程多由专家手工编写，维护成本高，且此前工作未实现完全自动化的教程生成。本文提出首个从自然语言任务描述自动生成 Excel 教程的框架：先实例化任务，再由核心组件 Execution Agent 在 Excel 中规划并执行解决方案，收集中间产物，进而转换为结构化文档和视频演示。作者从真实场景收集了 1,559 条任务描述，并设计结合大语言模型与人工评审的系统评估。实验表明，该框架的任务执行成功率比当前最佳基线提高 8.5%，生成教程的可读性与教学效果常接近甚至超越专家材料；自动化流水线还消除了人工劳动，将时间成本降至专家编写的 1/20。
Excel is one of the most widely used productivity tools across domains, offering rich functionality but also overwhelming users with its complexity. This creates a persistent demand for tutorials to support effective usage. However, while building and maintaining the Microsoft tutorial corpus, we observed that existing tutorials are manually created by experts, need frequent updates with each software release, and involve substantial human labor. Moreover, prior work has not achieved fully automated tutorial generation. In this paper, we present the first framework for automatically generating Excel tutorials directly from natural language task descriptions. Our framework first instantiates the task. Then a central component of this framework, Execution Agent, plans and executes the solution in Excel, and collects the intermediate artifacts required for tutorial construction. These artifacts are then transformed into both structured Excel documents and video demonstrations. To build a comprehensive tutorial corpus, we collected 1,559 task descriptions from real-world scenarios. In addition, we designed a systematic evaluation framework that integrates assessments from both large language models (LLMs) and human reviewers. Experimental results show that our framework improves task execution success rates by 8.5% over state-of-the-art baselines. Moreover, the generated tutorials demonstrate superior readability and instructional effectiveness, often approaching or surpassing expert-authored materials. Importantly, the automated pipeline eliminates manual labor and reduces time costs to 1/20 of expert authoring, making scalable and high-quality tutorial generation practical for the first time.
DOI 原文 · arXiv · PDF（开放获取） · DBLP
@inproceedings{XieMMZWZLQLRHZ26,
title = {From Task to Tutorial: An Automated GUI Framework for Excel Tutorial Document and Video Creation},
author = {Yuhang Xie and Jian Mu and Xiaojun Ma and Chaoyun Zhang and Lu Wang and Mengyu Zhou and Mugeng Liu and Si Qin and Qingwei Lin and Saravan Rajmohan and Shi Han and Dongmei Zhang},
booktitle = {FSE},
year = {2026},
doi = {10.1145/3803437.3805216}
}