Recipe: Run a judge in CI without auto-merging on pass
Recipe — gate CI on a judge verdict without auto-merging on pass.
Last updated
Was this helpful?
Recipe — gate CI on a judge verdict without auto-merging on pass.
When to use: judge is reliable enough to fail on, but you want human review on pass too.
CI runs the judge as a required check.
Failure blocks merge (hard gate).
Success is signal but doesn't auto-merge — keep human reviewer required.
.github/workflows/eval.yml:
- run: python scripts/ci-eval.py
# Exits 1 on regression; otherwise 0. PR rules require this check + a reviewer.Last updated
Was this helpful?
Was this helpful?