AI rubric

Full solutions are graded against an explicit rubric rather than a single scalar answer.

when to use it

Free-response problems are intended for proofs, open-ended derivations, and work that does not fit a fixed sequence of input fields. The usual strategy is rubric-ai; manual is used for work that needs a human decision. Reviewers finalize flagged work through the separate submission-review workflow.

rubric items

A rubric item describes what the grader should assess, how many marks it carries, its M/A/R type, the criteria, and evidence to look for. Optional examples and common errors help calibrate grading.

{
  "id": "factorization",
  "description": "Factors n^3 - n correctly",
  "marks": 2,
  "markType": "M",
  "criteria": "Uses n(n - 1)(n + 1).",
  "lookFor": ["consecutive integers"]
}

review states

• ai-graded means the AI result was returned without a review flag.
• flagged means the result needs human review and does not apply Elo yet.
• manually-graded means an authorized reviewer finalized or revised the grade.
• Appeals use a separate pending, upheld, or revised state without erasing the underlying final grading status.