Confident AI (DeepEval)
Pytest-style open-source LLM evaluation framework (DeepEval) with a hosted platform for benchmarking, regression testing and red-teaming (DeepTeam).
| Category | Evals & Testing |
| Open source | Yes |
| Self-hostable | Yes |
| Pricing model | freemium |
| Pricing notes | DeepEval framework free OSS (Apache-2.0); Confident AI cloud has free + paid tiers |
| Framework integrations | openai-sdk, langchain, llamaindex, anthropic |
| Funding / ownership | YC W25; $2.2M seed |
Pricing/feature source: https://www.confident-ai.com/pricing