Benchmarks (Premium custom)

The Stratix Premium Benchmarks surface — public benchmarks plus your private datasets.

Available in Stratix Premium. This surface is part of the logged-in workspace at stratix.layerlens.ai. Stratix Public users can browse the catalog but cannot use this feature.

The Premium Benchmarks page mirrors the public catalog and adds your private benchmark datasets — datasets you've uploaded that are scoped to your org.

URL: stratix.layerlens.ai/dashboard/benchmarks

What you can do

• Browse all public benchmarks (52+)
• Browse your org's private benchmarks
• Upload a new private dataset as a benchmark
• View score history per benchmark across all your runs
• Create a new evaluation directly from a benchmark page

Uploading a private benchmark

A private benchmark has:

• Name and description — for your team's context
• Dataset — CSV, JSONL, or Parquet with input column + expected-output column (or other schema)
• Scoring config (optional) — default scorers/judges to apply when this benchmark is selected for an evaluation

Upload from the Benchmarks page → Upload private benchmark.

Per-benchmark page (private)

For your private benchmarks:

• Dataset preview (first 50 rows)
• Schema (input → expected output mapping)
• Score history of your evaluations against this benchmark
• "Run new evaluation against this benchmark" shortcut

Where to next

• Stratix Public — Benchmarks catalog
• Evaluations
• Concept: Models and benchmarks