AI rubric

Full solutions are graded against an explicit rubric rather than a single scalar answer.

when to use it

Free-response problems are intended for proofs, open-ended derivations, and work that does not fit a fixed sequence of input fields. The usual strategy is rubric-ai; manual is available when a human reviewer must make the final decision.

rubric items

A rubric item describes what the grader should assess, how many marks it carries, its M/A/R type, the criteria, and evidence to look for. Optional examples and common errors help calibrate grading.

{
  "id": "factorization",
  "description": "Factors n^3 - n correctly",
  "marks": 2,
  "markType": "M",
  "criteria": "Uses n(n - 1)(n + 1).",
  "lookFor": ["consecutive integers"]
}

review states

• ai-graded means the AI result was returned without a review flag.
• flagged means the result needs human review and does not apply Elo yet.
• manually-graded and appealed represent human-review workflows.