glossary
The terms used across the docs and the solving interface, in plain language.
- answer-only
- A problem with one final response, graded deterministically.
- guided
- A problem split into ordered steps, each with its own response and marks.
- free-response
- A problem where the student writes a complete solution, usually against a rubric.
- response.kind
- The input shape rendered for a student: multiple-choice, numeric, expression, or text.
- grading.strategy
- The server-side evaluation method: exact, numeric, equivalence, rubric-ai, or manual.
- M / A / R
- Method, Answer, and Reasoning marks used for guided steps and rubric items.
- Elo
- A rating that estimates a user or problem’s current competitive level.
- re-attempt
- A later submission for the same problem; the user K-factor is halved.
- flagged
- A grading result held for human review, with Elo deferred.
- submission review
- Human grading of flagged or manual solver work. This is separate from question publication review.
- grade appeal
- A solver’s request for a reviewer to reconsider a finalized grade.
- upheld
- An appeal decision that leaves the existing final grade unchanged.
- revised
- An appeal decision that replaces the final grade and reconciles only the rating difference.
- sanitized problem
- The public problem payload with correct answers, grading specs, and solutions removed.
source of truth
The public docs describe the current schema and behavior. Implementation details may change as the product evolves. See reviews and appeals for the human-grading lifecycle.