一句话:提出 DAFeeD,用 LLM 为学生提交生成个性化迭代反馈,并在 Artemis 平台验证其提升学习表现。
随着学生人数增长,教师难以为每次作业提供及时且个性化的反馈,导致反馈工作耗时、重复且负担沉重。本文提出 DAFeeD,一种基于 LLM 的自动化反馈方法,适用于多种练习领域:它将任务说明、评分标准、学生解答与自定义指令纳入提示,支持学生在截止前多次提交并获得迭代式反馈。作者在开源学习平台 Artemis 中实现 DAFeeD,并通过受控用户研究及 450 名学生的软件工程课程部署进行评估。结果表明,学生认为反馈相关且有益,因其便捷和即时更愿意主动请求反馈;课程部署还提升了学生表现,并促进了多次提交的迭代改进。
Timely and individualized feedback is essential for students' learning progress and motivation, yet providing such feedback has become increasingly challenging due to growing student numbers. This has resulted in a time-consuming, repetitive, and often manual task for educators, contributing to a high workload. This paper presents DAFeeD, an LLM-based approach for automated feedback on student submissions across various exercise domains. The defined feedback process enables interactive learning by allowing students to submit solutions multiple times and automatically receive iterative LLM feedback on their submission attempts before deadlines. By incorporating task details, grading criteria, student solutions, and custom instructions into the prompt, DAFeeD provides clear, personalized, and pedagogically meaningful feedback to support continuous improvement. To evaluate the feedback process, we implemented DAFeeD in an open-source reference implementation integrated into the learning platform Artemis. A controlled study with students working on a programming task in a supervised environment showed that students found the feedback relevant and beneficial. They reported feeling more comfortable and willing to request automated feedback due to its convenience and immediacy. Additionally, deploying DAFeeD in a software engineering course with 450 students demonstrated improvements in student performance and encouraged iterative refinement through multiple submissions. These findings highlight DAFeeD's potential to enhance feedback processes in computing education, improving both learning efficiency and student outcomes.