decision models

A Python library for agent evals and guardrails that uses typed decision questions instead of an LLM judge. It supports one-request evaluation for traces, with examples for tool choice, grounding, relevancy, and injection checks.

An open-source Pac-Man benchmark where AI decision models compete in real time against scripted ghosts, with a public leaderboard, replayable games, and instructions for benchmarking your own endpoint.