For the complete documentation index, see llms.txt. This page is also available as Markdown.

From Promptfoo

Migrate from Promptfoo to Stratix.

What maps

Promptfoo
Stratix

tests:

Dataset rows

assertions: (deterministic)

Stratix scorers

assertions: (llm-rubric)

Stratix judges

prompts:

Prompt templates in evaluation config

Steps

  1. Parse promptfooconfig.yaml.

  2. Convert tests: to JSONL; upload as benchmark.

  3. Map each assertion type to a Stratix scorer or judge.

  4. Reproduce each prompts: variation as a separate eval run.

See also

Last updated

Was this helpful?