Evals & Testing

Deepchecks

Continuous validation suite from the ML-testing world extended to LLM apps, scoring outputs across versions from dev to production.

Website ↗ GitHub ↗
CategoryEvals & Testing
Open sourceYes
Self-hostableYes
Pricing modelfreemium
Pricing notesOSS package free; LLM evaluation SaaS with free + paid tiers
Framework integrationsopenai-sdk, langchain
Funding / ownership$14M seed (2022)

Pricing/feature source: https://www.deepchecks.com/pricing/