Evals & Testing

OpenAI Evals

OpenAI's original open-source eval framework and registry; largely superseded by the hosted Evals API but still a reference implementation.

Website ↗ GitHub ↗
CategoryEvals & Testing
Open sourceYes
Self-hostableYes
Pricing modelfree
Pricing notesMIT OSS framework; OpenAI platform also has a hosted Evals product billed via API usage
Framework integrationsopenai-sdk
Funding / ownershipOpenAI

Pricing/feature source: https://github.com/openai/evals