PyRIT

github.com · Safety & Evals

Open source

#8 in Safety & Evals

Microsoft's Python Risk Identification Toolkit for automating red-teaming of generative AI systems.

#open-source#red-teaming#microsoft#automation

Visit PyRIT ↗GitHub ↗

About the Safety & Evals category

Open frameworks, red-teaming kits, guardrails and benchmarks for measuring what frontier models can do and keeping deployed systems within safe bounds.

PyRIT is one of 10 safety & evals tools indexed on Intelsi. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.

// related

Related tools

All Safety & Evals →

garakgarak.aiLLM vulnerability scanner that probes models for jailbreaks, prompt injection, data leakage and other failure modes.Safety & EvalsOpen source★ 9.4k

HarmBenchharmbench.orgStandardised evaluation framework for automated red-teaming and measuring model refusal robustness.Safety & EvalsOpen source★ 1.1k

Inspectinspect.aisi.org.ukEvaluation framework from the UK AI Security Institute for building rigorous, reproducible LLM and agent evaluations.Safety & EvalsOpen source★ 2.9k

Guardrails AIguardrailsai.comFramework and hub of validators that check LLM inputs and outputs for risks and enforce structured responses.Safety & EvalsOpen source★ 7.5k

NeMo Guardrailsgithub.comToolkit for adding programmable rails to LLM apps: topic control, jailbreak detection, fact-checking and safe dialog flows.Safety & EvalsOpen source★ 7.2k

Purple Llamagithub.comMeta's umbrella project for open trust-and-safety tools, including Llama Guard classifiers and CyberSecEval benchmarks.Safety & EvalsOpen source★ 4.4k