For the complete documentation index, see llms.txt. This page is also available as Markdown.

Examples

Common layerlens CLI command sequences.

Run the gating eval in CI

layerlens evaluate --space my-regression-space --fail-on-regression --tolerance 0.005

Daily smoke

layerlens evaluate --space smoke --output json | jq '.score'

Bulk trace ingest

layerlens traces upload./traces-batch.jsonl --tag env=production

Compare two models

layerlens evaluate --model openai/gpt-4o --benchmark mmlu --output json > a.json
layerlens evaluate --model anthropic/claude-opus-4-7 --benchmark mmlu --output json > b.json
diff <(jq.accuracy a.json) <(jq.accuracy b.json)

Optimize a judge

layerlens judges optimize --judge-id JUDGE --dataset-id DATA --iterations 20

See also

Last updated

Was this helpful?