Ctrlk
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Author a custom code grader

Guide — author a custom code grader.

Premium → Scorers → New scorer → Custom code. Provide Python that returns a verdict dict. Test against samples.

See also

PreviousBuild your judge libraryNextDetect and remove flaky scorers

Last updated

Was this helpful?