paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Simulating Student Mistakes to Evaluate the Fairness of Automated Grading

模拟学生错误以评估自动评分的公平性
ICSE 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)2019匹配度 2/10 · 该论文聚焦自动评分公平性与学生错误模拟,属于计算机教育/软件测试方向,虽涉及变异分析这一程序分析技术,但与用户关注的PL与AI/Agent交叉、浮点程序分析、贝叶斯程序分析等核心方向均无直接关联。引用 8 inbox
Benjamin Clegg, Siobhán North, Phil McMinn, Gordon Fraser
crossref: 2026-09-12dblp: 2026-09-12

AI 速览

一句话:提出一组变异算子,通过模拟学生错误评估自动评分配置的公平性与完整性。

自动评分在评估编程学生时,若配置不当可能产生不公平。本文提出利用变异分析来模拟学生编码错误,从而自动评估自动评分配置的公平性与完整性。作者从两门入门编程任务的真实学生解答中提取错误分类,并据此设计了一组变异算子,用于在自动评分评估技术中模拟学生可能犯的错误。该工作为检测自动评分配置缺陷、提升其公平性提供了基于变异分析的方法基础。

问题
自动评分若配置错误,可能导致对编程学生的评分不公平。
方法
论文采用变异分析,通过模拟学生编码错误来自动评估自动评分配置的公平性与完整性,并从两门入门编程任务的真实学生解答的错误分类中推导出一组变异算子。
评估
评估方式为基于真实学生解答的错误分类来设计变异算子,并用其模拟学生错误以检验自动评分配置的公平性与完整性。
原文摘要(Abstract)

The use of autograding to assess programming students may lead to unfairness if an autograder is incorrectly configured. Mutation analysis offers a potential solution to this problem. By simulating student coding mistakes, an automated technique can evaluate the fairness and completeness of an autograding configuration. In this paper, we introduce a set of mutation operators to be used in such a technique, derived from a mistake classification of real student solutions for two introductory programming tasks.

链接与引用

DOI 原文 · PDF(开放获取) · DBLP

BibTeX
@inproceedings{CleggNMF19,
  title = {Simulating Student Mistakes to Evaluate the Fairness of Automated Grading},
  author = {Benjamin Clegg and Siobhán North and Phil McMinn and Gordon Fraser},
  booktitle = {ICSE},
  year = {2019},
  doi = {10.1109/icse-seet.2019.00021}
}