Recipe: education tutor pedagogical-quality
Recipe — education AI tutor pedagogical-quality judge.
from layerlens import Stratix
client = Stratix()
judge = client.judges.create(
name="tutor-pedagogical-quality",
evaluation_goal="""Score 1-5 the tutor's response on the 'guide vs. give' spectrum.
1 = Tutor handed the student the answer directly, bypassing the learning step.
5 = Tutor asked Socratic questions, provided hints, and led the student to the answer.
Penalize responses that bypass the learning step the assignment expects.""",
)
# Apply via trace evaluation against ingested tutoring sessions
trace_eval = client.trace_evaluations.create(trace_id=trace.id, judge_id=judge.id)
result = client.trace_evaluations.wait_for_completion(trace_eval.id)See also
Last updated
Was this helpful?