paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Direct Automated Feedback Delivery for Student Submissions based on LLMs

面向学生提交的基于LLM的直接自动化反馈交付
FSE Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering2025匹配度 2/10 · 该论文将 LLM 用于编程教育中的学生提交反馈,属于 LLM+编程教育/工具应用,但未涉及用户核心关注的静态分析、形式化验证、浮点程序分析或贝叶斯程序分析,也未与 Agentic 程序分析或 LLM 改进静态分析形成交叉。其工程落地和教学评估有价值,但研究问题与用户画像相距较远。引用 8 inbox
Maximilian Sölch, Felix T. J. Dietrich, Stephan Krusche
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出 DAFeeD,用 LLM 为学生提交生成个性化迭代反馈,并在 Artemis 平台验证其提升学习表现。

随着学生人数增长,教师难以为每次作业提供及时且个性化的反馈,导致反馈工作耗时、重复且负担沉重。本文提出 DAFeeD,一种基于 LLM 的自动化反馈方法,适用于多种练习领域:它将任务说明、评分标准、学生解答与自定义指令纳入提示,支持学生在截止前多次提交并获得迭代式反馈。作者在开源学习平台 Artemis 中实现 DAFeeD,并通过受控用户研究及 450 名学生的软件工程课程部署进行评估。结果表明,学生认为反馈相关且有益,因其便捷和即时更愿意主动请求反馈;课程部署还提升了学生表现,并促进了多次提交的迭代改进。

问题
学生规模扩大使教师难以及时提供个性化反馈,反馈任务耗时、重复且工作量大。
方法
提出 DAFeeD,用 LLM 结合任务说明、评分标准、学生解答与自定义指令生成个性化反馈,支持多次提交的迭代反馈,并集成到 Artemis 平台。
评估
通过受控学生实验和 450 人软件工程课程部署,评估反馈相关性、学生接受度、学习表现与迭代提交行为。
原文摘要(Abstract)

Timely and individualized feedback is essential for students' learning progress and motivation, yet providing such feedback has become increasingly challenging due to growing student numbers. This has resulted in a time-consuming, repetitive, and often manual task for educators, contributing to a high workload. This paper presents DAFeeD, an LLM-based approach for automated feedback on student submissions across various exercise domains. The defined feedback process enables interactive learning by allowing students to submit solutions multiple times and automatically receive iterative LLM feedback on their submission attempts before deadlines. By incorporating task details, grading criteria, student solutions, and custom instructions into the prompt, DAFeeD provides clear, personalized, and pedagogically meaningful feedback to support continuous improvement. To evaluate the feedback process, we implemented DAFeeD in an open-source reference implementation integrated into the learning platform Artemis. A controlled study with students working on a programming task in a supervised environment showed that students found the feedback relevant and beneficial. They reported feeling more comfortable and willing to request automated feedback due to its convenience and immediacy. Additionally, deploying DAFeeD in a software engineering course with 450 students demonstrated improvements in student performance and encouraged iterative refinement through multiple submissions. These findings highlight DAFeeD's potential to enhance feedback processes in computing education, improving both learning efficiency and student outcomes.

链接与引用

DOI 原文 · DBLP

BibTeX
@inproceedings{0002DK25,
  title = {Direct Automated Feedback Delivery for Student Submissions based on LLMs},
  author = {Maximilian Sölch and Felix T. J. Dietrich and Stephan Krusche},
  booktitle = {FSE},
  year = {2025},
  doi = {10.1145/3696630.3727247}
}