Evals & Testing

Promptfoo

Config-file-driven open-source CLI for prompt evals, regression testing and LLM red-teaming that runs in CI.

Website ↗ GitHub ↗
CategoryEvals & Testing
Open sourceYes
Self-hostableYes
Pricing modelfreemium
Pricing notesCLI/library free (MIT); paid enterprise for red-teaming at scale
Framework integrationsopenai-sdk, anthropic, langchain, ollama, vercel-ai
Funding / ownership$5M seed (a16z, 2024)

Pricing/feature source: https://www.promptfoo.dev/pricing/