agent testing

A Python library for agent evals and guardrails that uses typed decision questions instead of an LLM judge. It supports one-request evaluation for traces, with examples for tool choice, grounding, relevancy, and injection checks.

Open-source test runner for AI agent skills and multi-step workflows. It runs the same scenario across supported harnesses, captures evidence from tools, commands, files, and transcripts, and lets you assert on the observed behavior.

A deterministic security scanner and adversarial flight simulator for AI agents, built for red-teaming LLM workflows and MCP-compatible setups.

Giskard presents an AI red-teaming and continuous evaluation platform focused on finding hallucinations, security issues, and agent vulnerabilities. The page explains how it compares tools for agent-level testing, regression checks, and guardrail workflows.