garak vs PyRIT
Side-by-side comparison from the Agent Observability Index: licensing, self-hosting, pricing model and integrations — no vendor copy, primary sources linked.
| garak | PyRIT | |
|---|---|---|
| One-liner | Open-source LLM vulnerability scanner that runs pre-built probes for jailbreaks, leakage and injection. | Python Risk Identification Toolkit automating single- and multi-turn adversarial probing of GenAI systems. |
| Category | Guardrails & Safety | Guardrails & Safety |
| Open source | Yes | Yes |
| Self-hostable | Yes | Yes |
| Pricing model | free | free |
| Pricing notes | Open source (NVIDIA-maintained) | Open source (Microsoft) |
| Frameworks | OpenAI, Hugging Face, Ollama, REST | OpenAI, Anthropic, Ollama, Azure |
| Funding / ownership | NVIDIA-maintained open-source project | Microsoft AI Red Team open-source project |
How to choose
- Both link to primary pricing sources below — verify current tiers before committing; this market shifts monthly.