> For the complete documentation index, see [llms.txt](https://docs.layerlens.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.layerlens.ai/more-in-this-section-6/remove-flaky-scorers.md).

# Detect and remove flaky scorers

Guide — detect and remove flaky scorers.

Flaky scorers cause CI to fail on noise. Detect by:

1. Re-run the same evaluation 3 times back-to-back
2. Compute scorer-by-scorer variance
3. Scorers with high variance on identical inputs are flaky

Fix: pin model temperature to 0; add deterministic post-processing; or replace with a code grader if possible.

## See also

* [Concept: Scorers](/8.-evaluate-score-the-outputs/scorers-1.md)