Python SDK — quickstart

SDK quickstart — install, authenticate, run an eval.

pip install layerlens --extra-index-url https://sdk.layerlens.ai/package
export LAYERLENS_STRATIX_API_KEY="..."

from layerlens import Stratix
client = Stratix()

model = client.models.get_by_key("openai/gpt-4o")
benchmark = client.benchmarks.get_by_key("arc-agi-2")

evaluation = client.evaluations.create(model=model, benchmark=benchmark)
result = client.evaluations.wait_for_completion(evaluation)
print(f"Accuracy: {result.accuracy}")

Async

import asyncio
from layerlens import AsyncStratix

async def main():
 client = AsyncStratix()
 evaluation = await client.evaluations.create(...)
 return await client.evaluations.wait_for_completion(evaluation)

asyncio.run(main())

See also

• SDK reference
• Tutorial 1: First evaluation