Guide — standardize judges across teams.
In a multi-team org:
Centralize judge ownership in a platform team.
Curate cross-cutting dimensions (helpfulness, faithfulness, safety) once.
Tune against labels contributed from across teams.
Each product team uses the shared judges; only adds team-specific judges as needed.
Industry pattern: financial services ZIP-code penalty (cross-team standardization)
Workflow: Govern
Last updated 1 month ago
Was this helpful?