paperbot · PL 论文追踪

全部论文 待读 收藏

P2 Gradeer: An Open-Source Modular Hybrid Grader

Gradeer:一个开源的模块化混合评分器
ICSE 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)2021匹配度 1/10 · 该论文是关于编程课程作业的自动与人工混合评分工具,属于计算机教育/开发者工具方向,与用户关注的静态分析、形式化验证、浮点程序分析、贝叶斯程序分析以及 LLM/Agent 与程序分析的交叉均无直接关系。引用 0 inbox
Benjamin Clegg, Maria-Cruz Villa-Uriol, Phil McMinn, Gordon Fraser
crossref: 2026-09-12

AI 速览

一句话:提出并评估了Gradeer,一个结合自动与人工评分的开源模块化混合评分工具。

自动评估能大幅简化学生程序的评分过程,但人工评估对学生和导师仍有价值。本文提出Gradeer,一个混合评估工具,让导师能同时利用自动和人工评估的优势。Gradeer采用模块化设计,支持添加新的评分功能。它通过自动加载代码检查器、运行学生程序来直接辅助人工评分,并允许评分过程暂停后在原地恢复。作者将Gradeer用于一门Java入门编程课程的年终作业评估,发现其混合方法带来了多项好处。该工具已开源。

问题
自动评估学生程序虽高效,但人工评估仍有独特优势,如何将两者结合以提升评分效果。
方法
开发Gradeer混合评分工具,采用模块化设计以支持扩展新评分功能,自动加载代码检查器并运行学生程序,同时支持人工评分暂停与原地恢复。
评估
将Gradeer应用于一门Java入门编程课程的年终作业评估,通过实践发现其混合方法具有多项好处。
原文摘要(Abstract)

Automated assessment has been shown to greatly simplify the process of assessing students' programs. However, manual assessment still offers benefits to both students and tutors. We introduce Gradeer, a hybrid assessment tool, which allows tutors to leverage the advantages of both automated and manual assessment. The tool features a modular design, allowing new grading functionality to be added. Gradeer directly assists manual grading, by automatically loading code inspectors, running students' programs, and allowing grading to be stopped and resumed in place at a later time. We used Gradeer to assess an end of year assignment for an introductory Java programming course, and found that its hybrid approach offers several benefits.

链接与引用

DOI 原文 · PDF(开放获取) ·

BibTeX
@inproceedings{paperbot6259,
  title = {Gradeer: An Open-Source Modular Hybrid Grader},
  author = {Benjamin Clegg and Maria-Cruz Villa-Uriol and Phil McMinn and Gordon Fraser},
  booktitle = {ICSE},
  year = {2021},
  doi = {10.1109/icse-seet52601.2021.00015}
}